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A FACTORIAL ANALYSIS OF THURSTONE’S SIXTEEN 
PRIMARY MENTAL ABILITIES TESTS 


CHARLES H. GOODMAN 
THE PENNSYLVANIA STATE COLLEGE 


This article deals with a factorial analysis of Thurstone’s Pri- 
mary Mental Abilities Tests. The analysis was made in order to de- 
termine whether the tests designated to measure a particular ability 
would be found upon completion of the analysis to be clustered to- 
gether with significant loadings and be isolated from the tests of 
the other abilities. The results show that most of the tests specif- 
ically designed to measure six of the abilities were isolated with 
loadings varying in size. The tests for the remaining ability were 
not isolated. It is also shown that the tests are complex in nature, 
measuring more than any one single ability. 


During the past twelve years, Professor L. L. Thurstone has con- 
ducted a considerable amount of research in the field of factor analy- 
sis. One of the many outcomes of these experiments has been the 
publication of a battery of tests designed to measure seven abilities. 
Thurstone (5) isolated these seven abilities as a result of his analysis 
of a battery of fifty-six tests which were given to a group of 250 Uni- 
versity of Chicago students. These abilities were named: perception, 
number, verbal, space, memory, induction, and reasoning. The first 
five of these abilities are each measured by two tests, while the last 
two of these abilities are each measured by three tests, making a total 
of sixteen different tests in the battery. According to Thurstone (4), 
each test is heavily saturated with the particular ability that it is in- 
tended to measure. 

During the fall of 1938 the Thurstone Primary Mental Abilities 
Tests (Experimental Edition, 1938) were administered to a group of 
170 male freshmen engineering students at The Pennsylvania State 
College. Upon completion of the scoring process, the following ques- 
tion arose. Having presumably measured seven primary mental abil- 
ities, would it be possible to find the same seven abilities with which 
we started? Actually, the question is not one of verifying the com- 
position of the seven primary abilities, but rather whether a factor 
analysis would isolate the sixteen primary mental abilities tests so 
that the particular tests designated to measure each ability would be 
found clustered together with significant projections for that factor. 
If we accept Thurstone’s (4) statement that the tests are heavily 
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saturated with the abilities they were constructed to measure, it 
would seem, then, if the two or three tests designed to measure a par- 
ticular ability were isolated and found to have significant loadings 
that these abilities do appear to be in the battery of tests. This study 
was planned to answer the foregoing question. 


Subjects 


The population used in. the experiment consisted of 170 male 
freshmen taking the various engineering courses at The Pennsyl- 
vania State College. Their ages ranged from seventeen to twenty-one 
years, the mean age of the group being 19.58 years. These students 
were obtained as a result of an offer made to the entire freshmen en- 
gineering class of 278 students that those volunteering to take the 
tests would individually receive a psychograph of their abilities. It 
was thought that this procedure would result in greater cooperation. 
However, the question arose whether the students thus obtained 
would be a representative sampling of the entire freshmen engineer- 
ing class. In order to determine whether the subjects of this study 
were representative of the freshman engineering class and the col- 
lege population as a whole, a comprehensive investigation was made. 
The 170 subjects of this study served as the experimental group. The 
remaining 108 freshmen of the engineering class were used as a con- 
trol group and the 778 freshmen enrolled in the various schools.of the 
college served as a third group for the various comparisons that were 
made. The conclusions* of this ingestigation have been reported by 
the writer (3) in an earlier paper and show the subjects of this study 
to be a good representative sample of the freshmen engineering stu- 
dents and of the freshmen student body of The Pennsylvania State 


College. 
Statistical Procedure 


The subjects were assembled in groups of fifty and the Thur- 
stone Primary Abilities Tests were administered. Due to the length 
of time, three hours and forty-one minutes of actual working time re- 
quired to take the tests, it was decided to give the tests in two ses- 


* A few aspects of this earlier study are of sufficient interest to note briefly. 
On the DeCamp (2) Psychological Examination, a test heavily weighted with 
general information items, and found to have a multiple R of .70 with college 
grade-point average, the mean DeCamp test score and sigma for the experimental 
group were not significantly different from the mean and sigma of the control 
group. Application of the Chi-Square test for goodness of fit showed the dis- 
tribution of DeCamp test scores for the experimental group to be a good fit. The 
number of subjects found to be enrolled in each of the eight different engineering 
departments was closely similar in proportion to the numbers for the entire 


freshmen engineering class. 
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sions. Parts one and two were given in the first session and part three 
was given in the second session. 

These abilities tests were constructed so that they could be scored 
by hand or electrical scoring machine. Scoring of the tests was done 
in this experiment by hand. First each test was completely scored; 
then as a check for accuracy each test was rescored by odd and even 
items. These latter data were used in computing the reliabilities for 
each of the tests and have been reported by Bernreuter and Goodman 
(1) in an earlier article. 

The scores made by each of the subjects were punched into Hol- 
lerith cards and, with the aid of a tabulator, Pearson product moment 
coefficients were obtained between each of the sixteen tests. 

These intercorrelations and their probable errors are shown in 
Table 1 and it was this table of correlations that served as the matrix 
table for the factor analysis. Thurstone’s centroid method of fac- 
torial analysis was used. The data are analyzed to seven factors. The 
seventh factor residuals were examined for the largest positive and 
the largest negative entries in the new columns of the factorial ma- 
trix. None of these were found to be greater than +.10 and —.10. 
The maximum projection that could be obtained from rotation of the 
axes would then have been +.20. A projection of +.20 would account 
for only 4 per cent of the total variance of a test; hence there could 
be little assurance in the naming of a factor with so small a projec- 
tion. Thus it was considered that a sufficient number of factors had 
been drawn. An attempt was made to apply Tucker’s (5) empirical 
rule for determining the significant number of factors. However, the 
results were not clear enough to accept with assurance. The centroid 
analysis having been carried out, all of the factor loadings were col- 
lected into a single table, the factor matrix, and the communalities 
were computed for each of the tests. This is shown in Table 2. Then 
followed the process of rotation in order to make as many of the fac- 
tor loadings as possible positive, and as many of the loadings as pos- 
sible zero. The final outcome of this process of rotation is given in 


Table 3. 


Resuits 


Before examination of the outcome of the rotation of the axes, 
several items of interest can be noted in Table 1, the correlation ma- 
trix. It will be seen that the correlations between the tests of the fac- 
tors range from —.11 to +.72. Table 4 is presented to show how the 
tests of each factor correlate with each other. The correlations be- 
tween the tests of the number, verbal, and space factors are fairly 
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large, while the correlations of the perception, memory, induction, and 
reasoning factors are fairly small. 

The tests of the factors perception, memory, induction, and rea- 
soning correlate higher with tests which measure other factors than 
they do with tests that were designed to measure the same ability. 
Tests 1 and 2, which measure perception, correlate with each other 
.o2. However, Test 1 has its highest correlation of +.48 with Test 7 
of the space factor. Test 2 of perception has its highest correlation, 
+.43, with Test 6 of the verbal factor. Tests 9 and 10 of the memory 
factor correlate +.35, but Test 9 has its highest correlation, +.37, 

th Test 8 of the space factor, while Test 10 of memory also has its 
highest correlation, +.48, with Test 8 of the space factor. Of the 
three tests of induction, Test 11 correlates +.28 with Test 12 and 
+.33 with Test 13, while Test 12 correlates +.23 with Test 13. The 
highest correlation of Test 11 is +.38 with Test 15 of the reasoning 
factor. Test 12 has its highest correlation +.32 with Test 7 of the 
space factor. The highest correlation of Test 13 is +.33 with Test 11 
of the same factor. The three tests of the reasoning factor correlate 
with each other in the following manner: Test 14 correlates +.44 
with Test 15 and +.15 with Test 16. Test 15 correlates +.01 with 
Test 16. The highest correlation of Test 14, +.44, is with Test 15 
of the same factor. Test 15 correlates highest, +.49, with Test 8 of 
the space factor, and Test 16 has its highest correlation, +.44, with 
Test 7 of the space factor. It is interesting to note that of the ten 
highest correlations for those tests measuring perception, memory, 
induction, and reasoning, six of them are with the two tests of the 
space factor. Of the 120 intercorrelations of the matrix table, 58 of 
these correlations appear to be significant when considered in terms 
of their P.E.’s. Nine of the 120 correlations are negative; however, 
they are small, ranging in size from —.01 to —.11. 


The term “primary factor” has led to a great deal of confusion. 
Many have interpreted it to mean a pure psychological factor. In the 
light of such an interpretation questions would arise in connection 
with the intercorrelations of the matrix given in Table 1. Theoreti- 
cally there should be no correlation between the tests of one factor 
and another if the primary abilities are pure. Wolfle (6) has clearly 
stated the problem in these words: “The factors defined by a simple 
structure are called primary factors. It should be emphasized that 
primary factors are defined mathematically; they do not necessarily 
have any genetic or psychological or philosophical primacy.” Never- 
theless, even from a factorial point of view the intercorrelations of 
the sixteen primary mental abilities tests would seem to indicate that 
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the individual tests are somewhat complex. Further evidence of this 
is found in the loadings of these tests for the various factors. 

The final step of a factorial analysis is the psychological interpre- 
tation of the rotated factors. For this study the answer to our question 
of whether it is possible to isolate the tests of each factor lies in the 
rotated loadings of Table 3. Examination of the projections of Col- 
umn I will quickly reveal that the two highest loadings are .80 and 
.76. Both of these projections are for the two tests which were de- 
signed to measure number ability. Following Thurstone’s (5) pro- 
cedure of not regarding a loading as significant unless it is as large 
as .40, it will be found that there are no other loadings in this column 
that are significant. Test 13, the Number Patterns test of the induc- 
tion factor, has the next highest loading of .29 in the column. This 
would account for only 8 per cent of the total variance of the test. 
Although this loading is not significant, it is of interest to note that 
this test also deals with numbers. It will also be seen that the tests 
having the lowest projections in this column are preponderantly those 
involving verbal matter. 

In Column II the three highest projections are .50, .48, and .41. 
All of these loadings belong to the three tests of the induction factor. 
Test 16, the Mechanical Movements test, designed to measure reason- 
ing ability, has a projection of .39, which appears to be a significant 
loading. Thurstone (5) in his analysis of the battery of 56 tests 
which were given to the 240 Chicago University students, also found 
the Mechanical Movements test of that battery to have a significant 
projection of .40 for the deductive factor. There are two other pro- 
jections of noticeable size in this column. The larger of the two is 
.08 for Test 7, the Cards test of the space factor. The smaller load- 
ing of .33 belongs to Test 14, the Arithmetic test of the reasoning 
ability. It is of interest to note that of the three loadings reported in 
this column other than those for the deductive factor, two of them are 
for tests of the reasoning ability. 


The two largest loadings of Column III are for Tests 7 and 8, 
the Cards and Figures tests of the space factor. Both of these tests 
have loadings of .76. There are only two other loadings in this col- 
umn worth noting: Test 10, the Initials test of the memory ability, 
has a loading of .87 and Test 1, the Identical Forms test of the per- 
ception factor, has a loading of .36. Examination of Thurstone’s (5) 
rotated factor matrix for his battery of 56 tests will disclose that the 
Identical Forms test of that battery had a projection of .32 for the 
space factor. This is almost as large as the loading found in this 
study. It would appear from the task involved in the Identical Forms 
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test that a type of visualizing would be called into play. However, it 
does not seem to be the same sort of visual manipulation as that nec- 
essary for the solution of the tests measuring the space ability. A 
comparison of the loading found in this study for the Initials test of 
the Memory Ability with that of the loading found by Thurstone in 
his study shows a marked difference. The loading for the Initials 
test on the space factor in this study was .37 while Thurstone (5) 
reports a loading of —.09 for the Initials Test used in his battery. It 
is difficult to offer a satisfactory explanation why this test, which was 
designed to measure the ability to memorize, would appear on the 
space factor, which calls for the ability to be able to think visually of 
geometrical forms in space. 

In Column IV the interpretation of the loadings appears to be 
very clear. There are only two loadings that can be regarded as sig- 
nificant. Both of these projections are for Tests 9 and 10, the Word 
Number test and Initials test of the memory ability. 

Tests 5 and 6, the Completion test and Same Opposites test, 
which both measure the verbal ability, have the highest projections 
of .68 and .71, respectively, in Column V. There are two other load- 
ings in this column that should be noted. The first is Test 2, the 
Verbal Enumeration test of the perception ability, which has a pro- 
jection of .43, which is, according to Thurstone’s criterion, significant. 
Examination of Test 2 will disclose that despite the fact that it pre- 
sumably measures perception, it is heavily loaded with verbal ma- 
terial and it would appear quite plausible that it should have a sig- 
nificant loading on the verbal factor. The other test having a notice- 
able loading in this column is Test 3, the Additions test of the number 
ability. It is difficult to comprehend what the underlying relationship 
might be in this instance. 

The loadings of Column VI present a rather clear picture. There 
are only two projections that can be considered significant. Both of 
these loadings are for tests which measure the reasoning ability. Test 
14, the Arithmetic test, has a projection of .51, while Test 15, the 
Number Series test, has a projection of .58. Thurstone devised three 
tests to measure this reasoning ability, but it can be seen from the 
projections of this column that only two of the tests have shown up 
significantly. The third test measuring this ability is Mechanical 
Movements, and it has a loading of —.06 in this column. According 
to the data presented here, it would appear that the Mechanical Move- 
ments test is not measuring the same ability as that measured by the 
tests of Number Series and Arithmetic. It will be recalled that the 
Mechanical Movements test correlated only +.01 with the Number 
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Series test and +.15 with the Arithmetic test. 

There are no loadings of any significance in Column VII. The 
highest loading to be found is .32 for Test 8, the Figures test of the 
space factor. It would be difficult to attempt to name the factor that 
might exist in this column with loadings of this size. 

It may be noted that this analysis did not identify Thurstone’s 
perceptual factor, which he has withdrawn from the Primary Mental 
Abilities Tests pending further study of this factor. 


Summary 


This study of the factorial analysis of Thurstone’s sixteen pri- 
mary mental abilities tests based on the first experimental edition, 
would seem to justify the following conclusions: 

(1) The factor analysis disclosed that it was possible to isolate 
the two or three tests which measured each factor except perception. 

(2) The particular tests designated to measure each of the six 
abilities of number, induction, space, memory, verbal, and reasoning, 
were found to be clearly isolated, clustered together, with significant 
factor loadings. 

(3) The Mechanical Movements test, one of the three tests des- 
ignated to measure reasoning ability, failed to have a significant load- 
ing for that ability. 

(4) The loadings of the tests isolated for each of the abilities © 
vary in size from .41 to .80. This would account for a range of from 
16 to 64 per cent of the total variance of the tests. 

(5) The correlation of some of the tests are higher with tests 
which measure other factors than they are with the tests that were 
designed to measure the same ability. 

(6) The correlations between the two or three tests which 
measure each of the particular abilities range between .01 and .72. 

(7) From a factorial viewpoint, some of the Primary Mental 
Abilities Tests can be regarded as being somewhat complex. This can 
be seen from the loadings these tests have on the various factors 
which indicates that more than one factor is involved in the test. 
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TABLE 4 


Table Showing the Correlations Between the Tests Which 
Measure Each of the Seven Factors 


















































| Factor No. Test Measuring Factor Coefficient of Correlation P.E. 
P 1 Identical forms +.32 05 
2 Verbal Enumeration 
N 8 Addition +.72 02 
4 Multiplication 
V 5 Completion +.61 08 
6 Same Opposites 
S 7 Cards +.63 .03 
8 Figures 
M 9 Word Number +.35 .05 
10 Initials 
11 Letter Grouping +.28 (11 &12) 05 
I 12 Marks +.33 (11 &18) 05 
18 Number Patterns +.22 (12 &18) .05 
14 Arithmetic +.44 (14&15) 04 
D 15 Number Series +.15 (14&16) 05 
16 Mechanical Movements +.01 (15 & 16) 05 
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AN EXACT TEST OF SIGNIFICANCE FOR MEANS OF 
SAMPLES DRAWN FROM POPULATIONS WITH AN 
EXPONENTIAL FREQUENCY DISTRIBUTION 


LEON FESTINGER 
STATE UNIVERSITY OF I0OWA* 


The mathematical derivation of a test for determining the fidu- 
cial limits of, and significance of difference between, means when 
the samples are drawn from exponential populations is presented. 
The test for differences between means takes the particularly simple 
form of the F' test (the ratio of the larger to the smaller mean) 
with each mean possessed of 2n degrees of freedom, n being the 
number of cases in the sample. Random sampling, a range of scores 
upwards from a lower limit of zero, and independence of means from 
each other are necessary assumptions for the use of the test. Ex- 
amples of situations in which the test should be used are given, to- 
gether with a description of the necessary computational proce- 
dures. Comparisons of the results of the application of this test 
with the erroneous application of the critical ratio on actual data 
show that rather large discrepancies exist between the two tests. 
Results obtained by applying tests which assume normality to ex- 
ponential distributions are subject to much error. 


The research psychologist is frequently confronted with data 
where the frequency distributions are exponential in character. Such 
distributions occur, for example, in studies involving cultural or in- 
stitutional behavior, where there is a maximum frequency at the cul- 
tural norm and a tapering off of frequency in one direction away 
from this norm (J-curves) and in time observation studies of indi- 
viduals and groups where for many behavior items there is a maxi- 
mal frequency at zero occurrence within a given time interval and 
the frequency decreases progressively as one moves out to greater 
and greater numbers of occurrences per unit time. 

As yet, when dealing with such distributions there has been no 
method for testing hypotheses as to the value of the true mean or for 
testing significance of differences between means. The ¢ test is obvi- 
ously incorrect in such instances, since even for large samples the 
means do not distribute themselves normally. The present paper pre- 
sents the mathematical derivation, and some applications, of an exact 
test for means of samples from exponential populations. 


* From the Iowa Child Welfare Research Station. 
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I. Fiducial limits of the population mean: 
Let us assume a population with an exponential frequency func- 
tion, the general form of which may be written: 


f(z) =ce™; O<24<o, (1) 
The constants b and c of this function may be expressed in terms of 
moments of the distribution. Thus, setting 
S° f(«)de=k, 
and 


~ [“xf(2)de=a, 


and solving, we find c = kb and b = 1/z,, where z, is the population 
mean and k is the total area under the curve. We may then write 
equation (1) as: 


f(a) == eo"; 0<24<%, (la) 
p 


Craig* (2) has demonstrated that for a given population repre- 
sented by the distribution function (1a), the arithmetic means (z,) 
of samples of size » will distribute themselves in accordance with: 


(kn) n 7,1 


PP RD I a NZa/Zp 2 
z,"(m— 1)!” (2) 


$(x.) = 


To get the probability distribution of x, we have merely to set k= 1. 
By regrouping of terms and setting k = 1, we may write equation 
(2) in a more convenient form: 


( NX» ;- E-(Nre/Zp) 








Xy 
$ (2s) a? ocr . (2a) 
n 
Equation (2a), then, represents the distribution of 2, . 
Let us find the distribution function of z, where z = a e 


may then write: 


*TIrwin (4) has, by a different method, found the same distribution function 
for means from an exponential population, thus checking the results of Craig. 
In Irwin’s derivation the distribution function of means from an exponential 
population comes out as a special case of the distribution of means from a Pear- 
son Type III population. 
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2n 
ep 
and 
Lp 
dx, = — dz. (3a) 
2n 


The integral of f(x;) from 2%, to %s2 must equal the integral of 


x x 
f(z) from Zz, to Z.. We may then write: 


Tsz 
n-1 
1 =) e-(nts/Zp) dx; 
Lp Xp 
— (n— 1) [Vee 
n 


as J er . 
Lp 
pmnel non 1 ! @,/2n 23 
. (n — 1) 


n-1 
e- (*/2) 


then: 


= 
2 





F(z) = 





=7"(= ) ' (5) 


2(n—-1)! Ly 


Let us now turn our attention for a moment to the distribution 
function of Chi Square. This function, as given by Kenney (5), is: 


2 \k-1/2-1 
( al e- (47/2) 
2 


F (2?) = for (k — 1) degrees of freedom. (6) 
2 (>) 
2 
It may be observed that equations (5) and (6) are identical [n in 
equation (5) equals $(k—1) of equation (6)]. In other words, 2z,/z, 
distributes itself as Chi Square for 2” degrees of freedom. 

It is then obviously possible to test any hypothesis as to the value 
of the true mean, given a sample mean from an -xponential popula- 
tion, by referring 2nz,/x, to the table of Chi Square for 2n degrees 
of freedom. For n greater than 15, \/4nz,/x, distributes itself ap- 
proximately normally about \/4n—1 with unit variance and so the 
quantity \/4nx,/x, — VV 4n—1 may be referred to the normal prob- 
ability scale. 
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Let us work through an illustration of each of the above cases 
(n less than 15, and 7 greater than 15) to show more clearly the usage 
of this test. 


Example for n < 15 


A sample of 6 cases drawn at random from an exponential popu- 
lation. The mean of the sample is 10. The problem is to establish the 
1 per cent and 5 per cent level fiducial limits of the true mean. We 
find that Chi Square, for 12 (2n) degrees of freedom, must equal 
3.571 at the lower limit and 26.217 at the upper limit for significance 
at the 1 per cent level of confidence. Then 2nx,/x, must equal, in turn, 
3.571 and 26.217. Then 120/x, = 3.571 gives the upper fiducial limit 
of 33.60; 120/xz, = 26.217 gives the lower fiducial limit of 4.58. At 
the 1 per cent level of confidence, 4.58 and 33.60 are the limits be- 
tween which we may legitimately entertain any hypothesis about the 
value of the true mean. 

Likewise, the 5 per cent levels of Chi Square at the two ends of 
the distribution are 5.226 and 21.026. Setting 120/z, equal to each 
of these in turn, we obtain the limits of 5.71 and 22.96 within which, 
at the 5 per cent level of confidence, we may entertain hypotheses 
about the value of the true mean. 


Example for n > 15 


A sample of 20 cases drawn at random from an exponential popu- 
lation. The mean of the sample is 10. The problem is the same as in 
Example 1. The \/4n — 1 in this case equals 8.888. \/4nx,/2, in this 
case equals 28.284/\/x,. The normal probability table gives 1 per cent 
of the cases lying outside the mean plus or minus 2.58. We may then 
set 28.284/\/x, — 8.888 = + 2.58. Solving for x, we obtain fiducial 
limits of 6.08 and 20.11 within which we may entertain hypotheses as 
to the value of the true mean at the 1 per cent level of confidence. 

Similarly, using the value 1.96 instead of 2.58 in the equations 
above, and solving, we obtain the 5 per cent fiducial limits of 6.80 
and 16.67. 

It is important to note that the fiducial limits are not symmetrical 
about the obtained mean. 

It should be clear that for the test to hold, the population must 
vary from zero to infinity. If samples are obtained which are expo- 
nential in character, but where the lowest possible score is some con- 
stant c > 0, then the matrix must be transposed so that c= 0. For 
the purposes of the test we have merely to take (x,—c). 
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II. Significance of difference between means: 

It is important at this point to consider the distribution of the 
variance of samples of size n drawn from a normal population. This 
distribution, as given by Kenney (5), is: 

Ns? .. 


e- (N8?/20?) [| ___ 
20° 


20° r N-1\’ 
N 2 
where N is the number of cases in the sample, s? is the variance of 


the sample, and o? is the variance of the population. It may be observed 
that there is a similarity between equation (7) and equation (2). In 


H(s’) = (7) 





A 


2 No" 
fact, the quantity a. =.—— (where n = N — 1 = the degrees of 
oa o~ 


freedom and o? is the estimate of the population variance from the 
sample) is distributed as Chi Square for n d.f.. In other words: 


r(cz)ar(te era 


a vp 








Fisher’s z-distribution, then, holds for the logarithm of the ratio 
of means drawn from the same exponential population for degrees of 
freedom equal to 2n, and 2x, just as it holds for the logarithm of the 
ratio of variance estimates drawn from a normal population for de- 
grees of freedom equal to N, — 1, and N. — 1. In other words, the 
ratio of the means from an exponential population may be referred 
to the table of F' values, for the appropriate number of degrees of 
freedom, for a test of significance between them. Thus: 

Xsi 
——=F; degrees of freedom = 2n; and 2n,. (9) 


Lj 


III. Applications: 

The following are some cases, drawn from psychological litera- 
ture, where exponential distributions have been found. They will 
be discussed below to illustrate the applications of the test proposed 
in this paper. 

Case 1 

Dudycha (3) made observations on college students’ coming 
early or late in various situations. One of the measures computed for 
each person in each situation is the ratio of “number of times early” 
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multiplied by 100 divided by the ‘‘number of times present.”” The fre- 
quency distributions of this measure are presented [‘3), Fig. 7, p. 
25] and are obviously exponential in character. The individual scores 
range from 100 per cent early to zero per cent early with the maxi- 
mum frequency at the midpoint of the interval 100 - 95, and a taper- 
ing off from there on. 

Since our test requires the distributions to taper off from a maxi- 
mum at zero, we must, for the purposes of the test, transpose the 
scores by means of (100 — score) so that zero per cent is called 100 
per cent, and vice versa. 

Selecting two of the distributions, namely, promptness at break- 
fast (VN = 110) and promptness at 8:00 o’clock classes (N = 211), 
we find the means to be 5.4 per cent and 27.6 per cent, respectively. 
The author presents no test of significance between these two distri- 
butions, but we may ask ourselves whether these two means do or do 
not differ significantly. Since the F' necessary at the 1 per cent level 
is 1.33 for these magnitudes of degrees of freedom, it is apparent that 
the ratio of the larger to the smaller mean (27.6/5.4 = 5.11) is sig- 
nificant beyond the 1 per cent level of confidence. We may then con- 
clude that the two means are significantly different. 


Case 2 

Schanck (6) asked 61 people in a community to rate their atti- 
tude toward prohibition on a 4-point continuum ranging from “favor 
enforcement” to “favor modification.” The ratings were done in pub- 
lic and again in private. The distributions are of the type known as 
J-curves with the maximum frequency at “favor enforcement.” 

The four points on the scale may be given numerical values. We 
shall regard the first point as the midpoint of the interval from zero 
to 1 and assign to it the value of 0.5, to the next point the value of 
1.5, and so on. When this is done, the mean of the distribution for 
ratings in public is found to be .975, and the mean for ratings in pri- 
vate is found to be 1.189. 

The fiducial limits of the true mean may be found for either of 
these distributions. It is important to note, however, that the F test 
cannot be applied to test the significance of difference between the 
means since they both represent data on the same people and are 
therefore not independent. A test could be applied to the distribution 
of differences between the public and private ratings. 


Case 3 
Arrington (1) observed how frequently children spoke to other 
children in 5-minute periods of observation. The observations were 
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made in the normal preschool and kindergarten situation. The fre- 
quency distributions [(1), Figs. 4 and 5, pp. 74, 75] are obviously ex- 
ponential in character. The means obtained and the number of cases 
in each sample are given in the tabulation below. 


Boys Girls 
N Mean N Mean 
Younger nursery 19 2.61 17 2.22 
Older nursery 9 6.96 11 7.59 
Kindergarten 26 12.76 24 10.06 


In order to determine whether the mean number of times a child 
speaks to another child increases significantly as the children grow 
older, the author calculated the standard deviations of the distribu- 
tions and tested significance of difference between means with the 
critical ratio. For the difference between younger and older nursery 
school children, for boys and girls, respectively, the critical ratios ob- 
tained are 8.37 and 10.74. When the correct procedure of applying 
the F' test to the ratio of the larger to the smaller mean is used, the 
F’s are 2.667 and 3.419, respectively. The difference is significant at 
the 1 per cent level since the values of F required for such signifi- 
cance, for the degrees of freedom involved, are 2.45 and 2.42, re- 
spectively. 

The differences between the older preschool children and the 
kindergarten children yield critical ratios of 9.20 and 6.53, respective- 
ly, for boys and girls. The correct F test yields F values of 1.833 for 
boys and 1.325 for girls, neither of which is significant even at the 5 
per cent level. The values of F' that would be necessary at the 5 per 
cent level, for the degrees of freedom involved, would be 2.04 and 
1.91, respectively. We must then conclude, contrary to the critical 
ratios, that these latter differences could very well have been obtained 
by chance. 

The present test makes available a correct method of analysis for 
means, and differences between means, of samples drawn at random 
from exponential populations. The test is easy to apply and should 
prove of value to the psychologist. 

To summarize, we shall list below the assumptions on which the 
tests are based: 

(1) The parent population has an exponential frequency dis- 

tribution. 


(2) The sample is drawn at random. 
(3) The scores of the parent population range upward from 


zero. 
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(4) If we are testing the significance of difference between 
a. the means are assumed to be statistically indepen- 
ent. 


REFERENCES 
Arrington, R. E. Time-sampling studies of child behavior. Psychol. Monog., 
1939, 51, No. 228, 3-193. 
Craig, A. T. On the distributions of certain statistics. Amer. J. Math., 1982, 
54, 353-366. 
Dudycha, G. J. An objective study of punctuality in relation to personality 
and achievement. Arch. Psychol., 1936, 29, No. 204, 1-53. 
Irwin, J. O. On the frequency distribution of the means of samples from a 
population having any law of frequency with finite moments, with special 
reference to Pearson’s Type II. Biometrika, 1927, 19, 225-239. 
Kenney, J. F. Mathematics of statistics, Part Two. 1939. New York: D. 
Van Nostrand Co. Pp. 202. 
Schanck, R. L. A study of a community and its groups and institutions con- 
ceived of as behavior of individuals. Psychol. Monog., 1932, 438, No. 195, 
1-133. 











PSYCHOMETRIKA—VOL. 8, NO. 3 
SEPTEMBER, 1943 


ON THE RELIABILITY OF A WEIGHTED COMPOSITE* 


CHARLES I. MOSIER 
SOCIAL SECURITY BOARD 


A general formula for the reliability of a weighted composite 
has been derived by which that reliability can be estimated from a 
knowledge of the weights whatever their source, reliabilities, dis- 
persions, and intercorrelations of the components. The Spearman- 
Brown formula has been shown to be a special case of the general 
statement. The effect of the internal consistency or intercorrelation 
of the components has been investigated and the conditions defining 
the set of weights yielding maximum reliability shown to be that 
the weight of a component is proportional to the sum of its inter- 
correlations with the remaining components and inversely propor- 
tional to its error variance. 


Although the usual purpose of weighting the component parts of 
a test battery in combining them to form a composite total score is to 
increase the validity of the composite, there may be times when it is 
desired to assign weights in such a way as to produce the most reli- 
able composite. In the absence of a measurable external criterion, for 
instance, the maximum reliability of the composite is certainly as le- 
gitimate a basis for assigning weights as is the intuitive assignment 
of small whole numbers. In any event, even if the weights are as- 
signed in such a way as to provide a least-squares estimate of some 
quantitative criterion, the investigation of the effect of the weighting 
of the components on the reliability of the composite is a problem of 
considerable, even if secondary, importance. 

The present paper develops a generalized formula for the reli- 
ability of a weighted composite, investigates certain special cases of 
unusual interest, and derives the conditions of maximum reliability.+ 


The Generalized Formula for the Reliability of a Composite 

The generalized statement of the reliability of a composite is a 
function of the reliabilities, the dispersions, and the intercorrelations 
of the components. It is here derived and stated in both explicit and 
in parametric form. Let us suppose a composite variable y , consisting 

* The opinions expressed in this article are those of the author and do not 
necessarily reflect the official views of the Social Security Board. 

}~ Certain of the deductions set forth in this paper are implicit in Kelley, 
T. L., Statistical Method, Chapter IX, and others in Richardson, M. W. “The 


Combination of Measures,” in Horst, Paul, The Prediction of Personal Adjust- 
ment, Social Science Research Council, 1941. 
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of the weighted sum of m component scores, 11, %2,°++ , Xj,°*+, Un, 
so that for any individual, 7, 


yi == Witir + Woitig + +9 + Wyss ++ + Wrrtin, (1) 


where both y; and x; are deviation scores. 
Let us represent the variance due to error of the j-th component 
by its squared standard error, given by 


e?; = 07; (1 — 7j;), (2) 


where 7;; is the reliability of the component x;. Now, since the 
error variance of each x; is multiplied, in its contribution to the error 
variance of the composite, by W; and since by definition the error 
variances of the components are uncorrelated, we may write the 
error variance of y as 
n n n n 

a, = W?; &; = W?; 07 (1 — 7553) =D W507; — > Wj07s75;. (8) 
J J J 


j 


Now the total variance of the composite y is given by the expression 


oy = W?,0"; + W?.02? tee + W? 0°) + eee + W?,.0*n 
= Sb 27r,;W,W 0,0; Air sash 27 j1,W | Wrojox (4) 
=> W? 07; + 2> > Wi Wrojoxr jx. (j < k) 
j jk 


But the reliability of y may be expressed as a function of the ratio of 
the error variance to the total variance, thus 


(5) 
a es i<k) 
> W? ;0?; -- 23 3 W Wyo jor? jx 


j j=1 k=a 





This, then, is the basic formula by which the reliability of the weight- 
ed composite may be estimated from a knowledge of the dispersions, 
the weights, the reliabilities, and the intercorrelations of the compo- 
nents. The W; may be the weights obtained from a least-squares re- 
gression equation, or the small whole numbers assigned on some arbi- 
trary or intuitive basis to increase the “validity” with which the com- 
posite will predict some vaguely defined, unmeasured “criterion.” In 
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either case the reliability of the resulting composite may be estimated 
from equation (5). 

It is convenient, and in accord with common practice, to simplify 
equation (5) without loss of generality by the reduction of the x; to 
standard scores and the introduction of the parametric equation. 


w; = Wjo; (6) 


so that (5) becomes 


DU; — Sw 575; 





ja jm 
— 1- n nl n ? (7) 
Dw + 2D J Wiwer jx 
j=1 j=1 k=2 


remembering that 7 < k. Equation (7) may also be written as (8) 


n nm1n 
D> W755 + 2D J Wwe ix 
7 j=l k-2 
Ty = meee . (8) 
Dw + 2D J Wiwrrix 


j=1 k=2 





Equation (8) is of especial interest, since it can readily be reduced 
to matric form. Let us define a row vector, W; , on the range j, con- 
sisting of the n weights, w;; let the matrix of intercorrelations of the 
components be 7, where 7;; is, as defined above, the reliability coef- 
ficient of the test 7; let us also define a second matrix R so that each 
element Rj, = 7; , but the diagonal elements, R;; = 1 # 7;;. Then the 
numerator of (8) is seen to be W; r W’; and the denominator is seen 
similarly to be WRW’ , the expressions for numerator and denomina- 
tor differing only in the diagonal elements of the matrix of inter- 
correlations, since these are reliability coefficients in the numerator 
term and total variances in the denominator term. Equation (8) 
written in matric notation is thus seen to be: 


T—Wrw'(WwRwWw’)-. (9) 


Special Cases and General Interpretations. Before determining 
the values of w; which make r,, a maximum, it may be of interest to 
investigate certain special cases and general properties of the formu- 
lation. The most obvious conclusion is, of course, that ”,, is unity if, 
and only if, every r;; for which w; is not zero is also unity—a conclu- 
sion of some consequence for the practice of attempting to increase re- 
liability solely by adding items. Similarly, if every 7;; is zero, with its 


Se ar 
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corollary that every 7; is zero, then it follows that r,, is zero—not a 
very profound conclusion. 

Concerning the values of the variables, w;, 7; and 7;;, we may 
make certain assumptions and investigate the effect of these special 
conditions. This has been done systematically for equal and unequal 
weights, equal and unequal reliability coefficients, and for 7, equal to 
zero, unity, and unity when corrected for attenuation, i.e., 7j,= V1; ;Tix 
Only those cases of particular interest are reported here. 

The Spearman-Brown Formula. A special case of particular in- 
terest is the Spearman-Brown formula. If not only the dispersions 
are equal [or equated as in (6)], but the weights of the components 
are equal, and set for convenience equal to unity, and if, in addition, 
the reliabilities are also equal, equation (7) becomes 








nN— N73; 
Tw =1- ——. (10) 
n+2> Tra 
j=1 k-2 


But remembering that j < k, and letting 7;, be the average value of 
YT ik ’ 
m1 n 


23 Trin = n(n — 1) Fx. (11) 
j=1 k=2 


and making this substitution in equation (10), we have 
a(i— Yjj 1 — Ty 
yt — wy s (12) 


n+n(n—l)?,y Lt (n—LFp’ 








Equation (12) not only constitutes a lemma convenient in the 
derivation to follow, but contains certain conclusions of importance, 
to which reference will shortly be made. 

If the intercorrelations of the components are equal and, when 
corrected for attenuation, are equal to unity so that each component 
is measuring the same variable, i.e., 

a 1 (13) 


VT; ; Nek 


and rj; = fa, 1x — 7;;, then equation (12) becomes 





(14) 


This is the familiar Spearman-Brown formula for estimating 
test reliability, seen here to be a special case of the reliability of a 
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weighted composite as given by equation (5) under the conditions 
that 
Vik 
W;= Wi, Oj; = OK, Vij = Nees and ————_=—1. 
V1 55 Vex 

Returning to equation (12), it can be seen that the reliability of 
a composite of equally weighted standard scores increases with in- 
creasing average intercorrelation of the components. This conclusion 
has been stated before by Richardson and is implicit in the Richard- 
son-Kuder treatment of reliability. The significance of its restate- 
ment here is that the same conclusion appears again as a lemma in 
the development of the Spearman-Brown formula, which has been 
considered by Kelley* as a measure of reliability of a different nature 
from the Richardson-Kuder reliability. The effect of the intercorrela- 
tions of the components is investigated further below. 

Effect of Interrelationships of the Components. Certain effects 
of correlated vs. uncorrelated components on the reliability of the re- 
sulting composite can be deduced as special cases from equation (8), 
repeated here for ready reference. 





n n1 nn 
Dj W755 + 2S DS WW in 
j j=1 k-2 
Tw = nl 7 c (8) 
aw’; + 2d = Wj WEP jx 
j=1 ke 
If the components are mutually uncorrelated, so that for any 
pair of components, 7 and k, r;, = 0, equation (8) reduces to 


‘ _ 2 wini 
- > wv; 





(15) 


This is equivalent to the statement that, for mutually uncorre- 
lated components, the reliability of the weighted composite is a 
weighted mean of the reliabilities the weight of each being w*;. For 
equal weights, this reduces to the mean reliability of the components, 
a value generally less than that of the most reliable of the sub-tests. 
In view of the tendency among some workers in the field to seek un- 
correlated components for prediction, due to the dependence on the 
multiple regression concept,} this conclusion is of more than passing 
interest. 

* Kelley, T. L., The Reliability Coefficient, Psychometrika, 1942, 7, 75-88. 

+ On this, cf. Richardson, M. W. “The combination of measures.”’ In Horst, 


Paul, The Prediction of Personal Adjustment, Social Science Research Council, 
1941, especially pp. 392 and 897. 
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The frequent loose statement of the Spearman-Brown formula, 
ignoring the assumptions following equation (14), as “The reliability 
of a test increases as its length increases,” together with a loose appli- 
cation of the principle of multiple regression and its corollary that 
“Other things equal, Ry.;x.... is a maximum if the intercorrelations, 
Tj, are a minimum,” has led to the uncritical combination of unre- 
lated measures to increase “validity” for some vague and ill-defined 
criterion, without regard for the effect on the reliability of the meas- 
ure. 

When, on the other hand, the intercorrelations are all equal to a 
given value, say 7; , equation (8) becomes 


aa D wri + wt D> ww 
DW; + 2K in yy Wie 
If, moreover, the reliabilities are also equal, this becomes 
ng ws +2Tnosd wil 
Sw? + 2% ES wir 
If, however, the weights are equal, but the reliability unrestricted, 


equation (16) becomes (remembering j < k and letting the mean of 
the n reliabilities be 7;;), 


__ Fy + (mn — 1) Fix 
mw 1L+ (n—-dlYdFR 





(j < k) (16) 





(17) 





(18) 


The third possibility with regard to the intercorrelations of the 
components is that, when corrected for attenuation, they are equal to 
unity as in 

V jx = VV ii Vee - (13) 


Under this condition, the expression for the reliability of a composite 
becomes of especial interest only if the reliabilities are equal. Then 
Tix = 7;; and equation (8) may be written 


ila yw; + 25D wir (19) 
YZ we, +27, TDDwuwr 


1) hamah mud 





Since 7r;; < 1, the denominator of the fraction is always less than the 
numerator and, hence, for equal reliabilities of tests all measuring the 
same factor, 7,, is greater than r;;. If, as we have seen earlier, the 
weights are also equal, 7,, is given by the Spearman-Brown formula. 

Weighting for maximum reliability. Given the algebraic state- 
ment of the reliability of the composite in terms of 7; , 7, and wy, 
in which the first two sets of values are given by the data, it would 
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appear simple to determine that set of weights yielding maximum re- 
liability. The general approach is, of course, obvious—obtain the set 
of partial derivatives of equation (7) with respect to each w; in turn, 
and solve the resulting set of homogeneous equations simultaneously, 
arbitrarily equating one of the w; to unity. The actual solution for 
the general case, however, is far from simple. . 

Differentiating equation (7) with respect to each weight, w,, 
in turn yields: 








Oy  —«--_ (RW — VW pp) (J w?; + 2D D Wwe jn) 
ow, c (CS w+ 2335 wywrr jx)? 
(2w,p + 23 win) (S ws — S w*575;) (20) 
. (k #p) 





(Sw? +23 5 Wiwr"ix)? 


If 67y,/0w, = 0, then the numerators of the two terms above are equal, 
thus: 


Wy (1 — pp) (S w?; +23 5 Wywrr ix) 
= (Ww, +S win) (Sw?) — Fw? i755). (21) 
Equation (21) defines a set of nm homogeneous simultaneous equations, 
since p may take each value from one through 7. These equations can 
be solved only by imposing a further limitation. 


It is convenient to define the weight of one variable, say the 
q-th component, as unity. Dividing each of the remaining (n—1) 











equations of (21) by the equation resulting from equating 2 to zero 
gives 
Wp + Dw, Y pk 
stan en) a 
Wa +S we Vox (k#~@q) 
or, since w,— 1, 
. W, + - Wy Tok 
—?r, 
a= (23) 


n-1 
1+ 5S wera 
k 


Clearing of fractions yields 


w,(1 ae Tp) (1 + Z Wr Nor) = w, (1 on Pex) + (1 ies foals Wy Tor « (24) 
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Subtracting w,(1 — 7.) from both sides yields 
Wy[ (1 — pp) (1 + S We Tx) — (l1-—1T%)] = Q- Tq) DV Wen (25) 


Expanding the bracketed term gives 





w,[1 -f. + > Wr Tox (1 =e) + Teal = (1 ae qq) = Wk Tx - (26) 
Solving explicitly for w, , 
w,= Y We Tx (1 — Toa) ws. (k#p) (27) 
(S We Tax) (1 — Top) +1 aq — Top (k#q) 


From equation (27) we can state that, for maximum reliability 
of the composite, the weight of a component is directly proportional 
to the weighted sum of its intercorrelations with the remaining com- 
ponents, and inversely proportional to its error variance. 

The explicit statement of equation (27) is given below for the 
case of two variables, where variable 2 is taken as the g-th compo- 
nent. 


— We T12(1 — Te2) 
w,— 
We T12(1 — Ty) + 22 Ti 





(28) 


w,=1, 
whence 
ae T12(1 — 122) 
te AQ —tn) +72 tn 





WwW, 


An exact solution to the equations for more than two variables 
is not apparent to the writer, although an iterative approximation 
should yield results. The difficulties of computation, however, render 
equation (27) of theoretical rather than practical value. 
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MULTIPLE RECTILINEAR PREDICTION AND THE 
RESOLUTION INTO COMPONENTS: II 
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Given a battery of n tests that has already been resolved into 
r orthogonal common factors and n unique factors, procedures are 
outlined for computing the following types of linear multiple re- 
gressions directly from the factor loadings: (i) the regression of 
any one test on the n—1 remaining tests; (ii) all the n different 
regressions of order n—1 for the n tests, computed simultaneously; 
(iii) the regression of any common factor on the n tests; (iv) the 
regressions of all the common factors on the n tests computed simul- 
taneously; (v) the regression of any unique factor on the n tests; 
(vi) the regressions of all the unique factors on the n tests, com- 
puted simultaneously. Multiple and partial correlations are then 
determined by ordinary formulas from the regression coefficients. 
A worksheet with explicit instructions is provided, with a complete- 
ly worked out example. Computing these regressions directly from 
the factor loadings is a labor-saving device, the efficiency of which 
increases as the number of tests increases. The amount of labor 
depends essentially on the number of common factors. This is in 
contrast to computations based on the original test intercorrelations, 
where the amount of labor increases more than proportionately as 
the number of tests increases. The procedures evaluate formulas 
developed in a previous paper (2). They are based essentially on a 
shortened way of computing the inverse of the test intercorrelation 
matrix by use of the factor loadings. 


1. Introduction 

Factor analysis and multiple correlation have at least three im- 
portant contributions to be made by either one to the other: 

(a) After a factor analysis has been performed, it is often pos- 
sible to simplify the labor involved in computing multiple regressions. 

(b) Factor analysis can give clues to aid in the selection of 
variables to use in regressions. 

(c) Since it has been shown that common and unique factors 
are not perfectly predictable in general from a finite number of tests, 
the whole foundation of the theory of common and unique factors 
must be re-examined and reformulated if it is to have any meaning 
with respect to real phenomena. 

These three points have been made, or are implicit, in a previous 
paper by Guttman (2). That paper is devoted to a large extent to 


* The junior author worked out the numerical example and wrote explicit 
directions for the worksheet. 
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deriving formulas for point (a) above, both for predicting test scores 
and for predicting factor scores. These formulas are basic to discus- 
sions of points (b) and (c). The present paper is devoted to exhibit- 
ing explicit numerical procedures for the evaluation of these formu- 
las. No knowledge is required here of Guttman’s previous paper. 

It is hoped that world events will be such that further papers, 
on points (b) and especially (c), can be prepared in the near future. 

As has been pointed out in (2), the use of the formulas for point 
(a) does not depend upon the meaning of factors. It is a purely alge- 
braic proposition which is universally legitimate as a mechanical 
means for computing ordinary multiple regressions. 


2. Prediction of Tests 

Conforming to terminology that has arisen from the fact that 
factor analysis was first developed in connection with psychological 
tests, we shall call any directly observed variable a test. The ordi- 
nary problem of multiple correlation is to predict a particular test 
from n—1 other tests. For a set of n tests, there are n different re- 
gressions of order n—1 (i.e., utilizing n—1 tests as predictors). The 
ordinary problem of partia! correlation is to examine the correlation 
between two tests when n—2 other tests have been held constant. In 
the completely linear theory, to which we are restricting ourselves 

n(n—1) 


throughout this paper, for a set of n tests there are oe as different 


partial correlations, holding n—2 tests constant. 

In standard methods for computing a multiple regression, the 
amount of labor increases far more than proportionately as the num- 
ber of tests increases. In the fortunate case where it is possible to 
“factor” intercorrelations of tests into common factor loadings, where 
the number of common factors is much less than the number of tests, 
Guttman (2) has derived formulas that shorten the work consider- 
ably.* We shall give an explicit, compact, numerical method for eval- 
uating these formulas, in terms of a numerical example. The compu- 
tational procedures can be followed without any knowledge of Gutt- 
man’s previous paper; they are handled routinely almost like an or- 
dinary Doolittie arrangement. In the present method, the amount of 
labor does not increase much proportionately as the number of tests 
increases. The amount of labor depends most essentially on the num- 
ber of common factors, rather than on the number of tests. 

By the present method, it is relatively easy to compute the re- 


* Much of the same ground has also been covered, with a rather different 
emphasis, by Dwyer in (1). 
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gression coefficients for the regression of any one test on the 7—1 re- 
maining tests, no matter how many tests there are, provided the num- 
ber of common factors is relatively small. It is also relatively easy to 
compute all the regression coefficients for all the n different possible 
regressions of order n—1 for the 7 tests. As is well known, when all 
the regression coefficients are given, it is a simple matter to compute 
all the multiple and partial correlation coefficients. 

The numerical example in §5 below shows how to compute any 
particular regression, and how to compute simultaneously all the pos- 
sible regressions of order n—1. 


3. Prediction of Factors 


Using a theory of common and unique factors to “factor” the in- 
tercorrelations of n tests introduces, in general, more factors than 
there are tests. In general, there are m unique factors—one for each 
test—and, say, r common factors, making a total of n+7 factors. The 
“factoring” process defines the correlations of the factors with the 
tests, these correlations being called the factor loadings.* However, 
such a “factoring” process cannot define the score of a person on a 
factor, as long as n is finite. This follows from the fact that n+r 
linearly independent variables cannot be expressed as linear functions 
of n variables. The only direct observations on hand are the scores 
of persons on the n tests, so that scores on the factors must be ob- 
tained somehow as functions of the observed test scores. But there 
are too many factors to be able to do this exactly. Hence the factor 
scores must be estimated or predicted from the test scores. This re- 
quires the multiple regression equation of each factor on the n tests, 
which we can compute exactly because only correlation coefficients 
are needed in the computations. We do know the intercorrelations 
between the v tests, and the correlations of the factors with the tests. 

These regressions are, then, of order n, since the n tests are 
used as predictors. However, there are simplified formulas again 
which make the labor involved depend essentially on the number of 
common factors, rather than on the number of tests. In the numeri- 
cal example below, it is shown how to compute the regression of any 
particular common factor on the n tests, and of any particular unique 
factor on the n tests. It is also shown how to compute all the regres- 
sions for the factors simultaneously. 

Again, once the regression coefficients have been computed, it is 
a simple matter to ascertain the multiple correlation coefficients. 


*The process also defines the correlations between the factors. We deal 
here only with uncorrelated factors. It is not difficult to extend the present pro- 
cedure to the case of correlated factors. 
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4. The Matric Formulas 


This section may be omitted by non-mathematical readers. It is 
a summary of the formulas derived in Guttman’s previous paper [see 
(2), pp. 91-92]. 

The matrix of the intercorrelations of the tests is denoted by R. 
It is of order nXn. The nXr matrix of common factor loadings is 
denoted by A. The nXn diagonal matrix of unique factor loadings is 
denoted by U. From the fundamental theorem of factor analysis, 

R= AA’+ U’, 

where the prime denotes the transposed matrix. All regression co- 
efficients for predicting tests from n—1 other tests are proportional 
to the elements of R-*. Hence, the computation of R* gives essentially 
all possible regressions of order n—1. The computational procedures 
using factor loadings are merely methods of simplifying the calcu- 
lation of R“, or of R“ multiplied by given matrices. 

Let Q=I1+ AU°*A. Then Q is non-singular and of order 7X7. 
Guttman shows that 


R-* =U? — U*AQ"AU”. ~ (1) 


The only difficult computation in the right member is to compute the 
inverse of the rXr matrix Q. In Table 5 below, the entire right mem- 
ber of (1) is computed as a single process. 

The regression weights for predicting the r common factors from 
the n tests are the elements of 


AR“ =Q?AU-. (2) 


Ledermann (5) has given a numerical model for computing the right 
member of (2), using Aitken’s pivotal condensation. In the nu- 
merical example below, we actually get the regression for the rth com- 
mon factor in essentially this manner, using instead the Doolittle 
arrangement. A Doolittle arrangement can of course be set up which 
would be equivalent to Ledermann’s procedure, but this is not a pur- 
pose of the present paper. Instead, we utilize the fact that R* has 
been computed fro. the right member of (1). Then the left member 
of (2) is easily co: puted by direct multiplication. 

Similariy, the regression weights for predicting the unique fac- 
tors from the tests are the elements of 


UR". (3) 


Once R" has been computed, according to the right member of (1), 
(3) is immediately obtainable. 
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5. Preparing the Worksheet 


As a numerical example, we shall take a fictitious problem of 
Holzinger [(4), pp. 32-36], which was also used by Ledermann (5). 
In Table 1 are the intercorrelations of Holzinger’s seven fictitious 
tests, and in Table 2 are the factor loadings on a particular set of 
factors. In this example, there are three common factors as against 
seven tests, so that the saving in labor will not be too considerable 
by the present method over some other method operating directly on 
the correlation coefficients. The example is only to illustrate the meth- 
od, and it will be apparent how considerable is the labor saved when 
there are, say, fifteen or twenty or more tests and only three or four 
common factors, or fifty tests with seven or eight common factors. 
Even for six or seven tests, if there were but one common factor, 
there would be little work at all in the present method. 

In all the computations below, the work was actually carried to 
three decimals, but the results are presented here only to two places. 

In the bottom section of Table 2, the first line contains the com- 
munality for each test, i.e., the sum of the squares of the com- 
mon factor loadings, denoted by h?. The uniqueness of a test is 
u? = 1 — h’, as recorded in the second line. The reciprocal of each 
uniqueness is recorded in the third line, to be used for computing 
Table 3. The loading of a test on its unique factor is wu, the (positive) 
square root of the uniqueness, as recorded in the last line. 

Table 3 is obtained by multiplying each column of the first sec- 
tion of Table 2 by its corresponding value of 1/u?. This augments 
the common factor loadings of a test according to the uniqueness of 
the test. 

Table 4 is actually a symmetrical table, so that the entries below 
the principal diagonal have been omitted for convenience. An entry 
in row i and column j of Table 4 is obtained by taking each entry in 
row 1 of Table 2, multiplying it by the corresponding element of row 
7 in Table 3, and summing the n products (n is the number of tests). 
For the diagenal elements, unity is added to the sum. Thus, the entry 
in row I, column II of Table 4, is 


(.7) (1.92) + (.6) (2.14) + (.5) (7.27) + (.7) (0) 
+ (.6) (0) +(.4) (0) + (.8) (0) = 6.27. 
The diagonal element in the third row and column is 
0+0+0+ (.6) (4.00) + (.6) (2.14) + (.8) (4.00) + 0 = 6.89 


plus unity. 
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All the requisite entries for the worksheet, Table 5, are now on 
hand. The instructions for the worksheet are self-explanatory, being 
rather similar to those for a Doolittle arrangement. 

Table 6 actually is seven (in general, n) lines of the worksheet. 
Row 1 of Table 6 is the sum of four (in general, r + 1) lines of Table 
5:12 + 13+ 14+ 15; row 2 is 16 + 17 + 18 + 19; etc. The entries 
below the diagonal are filled in by symmetry. The complete table is 
the inverse of the correlation matrix of Table 1. 

Table 6—and the worksheet—can be checked as follows: the 
sum of the products of the entries in row i of Table 1 by the corre- 
sponding entries in row j of Table 6 should be zero (within rounding 
errors) if i # 7, and it should be unity (within rounding errors) if 
i = 7. (In the matric formulation, this follows from the symmetry 
of R and the fact that RR“ — 1.) 


6. When the Entire Worksheet is Not Needed 

The entire worksheet above is not needed for many problems. If 
it is desired to find the regression of only a particular common factor 
on the n tests, the whole bottom section of the worksheet can be 
omitted. For example, on the present worksheet, we would need only 
the first eleven lines. The last seven entries on line 11 are actually 
the negatives of the regression coefficients of the tests for predicting 
common factor III (see §8 below). Had we wanted, instead, to pre- 
dict common factor II, say, we would have prepared the worksheet 
with the rows and columns for common factor II in the positions 
where those for common factor III are now. 

It would be very easy to modify the above worksheet to give di- 
rectly the regressions for all the common factors on the tests. This 
is done, for example, by Ledermann (5) using an Aitken arrange- 
ment. We shall not take the space here to give the equivalent Doo- 
little arrangement. What we shall do here is take advantage of the 
fact that the entire worksheet will be used for many problems, so that 
we shall use below a procedure for getting the regressions for all the 
common factors after the entire worksheet is completed. 

If it is desired to compute the regression of only a particular 
test and/or a particular unique factor, the entire worksheet is not 
necessary. On the present worksheet, if we wished to compute the 
regression of the first test and/or the first unique factor, we would 
need only the first fifteen lines on the worksheet, from which we get 
the first line of Table 6. As is indicated in computing Tables 8 and 12 
below, the entries in the first line of Table 6 are proportional to the 
regression coefficients for predicting the first test and the first unique 








afm AS = 
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factor. Again, if instead we had wished to predict only the jth test 
and/or unique factor, we would have arranged the rows and columns 
of the jth test and unique factor where those for the first test and 
unique factor are now on the worksheet. 

The entire worksheet is necessary for computing simultaneously 
the regressions for all tests and/or all unique factors. 


7. The Complete Set of Regressions for Tests 

To aid in computing the multiple and partial coefficients for pre- 
dicting tests, Table 7 is set up. The first row consists of the entries 
in the principal diagonal of Table 6, denoted by d. The second and 
third rows, as indicated in Table 7, are the reciprocal and square root 
of the reciprocal, respectively, of the corresponding element in the 
first row. 

The left-hand section of Table 8 is got from Table 6 by multiply- 
ing each row in Table 6 by the negative of the corresponding element 
in the second row of Table 7 (namely, —1/d). For example, the third 
row of Table 8 is —.31 times the third row of Table 6. 

The diagonal entries of Table 8 should all be —1.00 if computed; 
and they are omitted, since they are not regression coefficients but 
merely check the work. The jth row of Table 8 gives the n—1 regres- 
sion coefficients for predicting the jth test from the n—1 remaining 
tests (when all tests are in standard form). 

The index of multiple correlation is the term used here to denote 
the square of the multiple correlation coefficient.* As is well known, 
if 7;, is the correlation between variables 7 and k, and if bj; is the 
regression coefficient of variable k in the regression of variable j on, 
say, m variables, then the index of multiple correlation of variable 7 
on these variables can be computed from the formula 


T1051 + T j20 jo + slat + T jm0jm 


(assuming all the variables are in standard form). The multiple 
correlation coefficient is then, of course, the positive square root of 
this index. 

Thus, the index of multiple correlation of the third test in Table 
8, for example, is computed by multiplying each element in the third 
row of Table 1—omitting the diagonal entry—by the corresponding 
element in the third row of Table 8, and adding the n—1 products: 


* This is a far better term to use than “index of determination,” which gives 
misleading notions about causation. A further contribution of factor analysis 
to multiple correlation, which might be added as a fourth point to those at the 
beginning of this paper, is to afford a good device for showing how meaningless 
multiple correlation may be from the point of view of a causal analysis. See 
Section 20 of (3), pp. 289-291. 
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(.75) (.44) + (.78) (.52) + (.85) (—.05) + (.30) (—.02) 
+ (.20) (.02) + (.40) (—.06) =.69. 


This result is recorded in the next to the last column of Table 8. In 
the last column is recorded the multiple correlation coefficient, .83, 
which is the positive square root of .69. 

To obtain the complete set of partial correlation coefficients, 
Table 9 is first computed by multiplying each row of Table 6 by the 
negative of the corresponding element in the third row of Table 7, 
namely, —\/1/d. For example, the third row of Table 9 is —.56 
times the third row of Table 6. 

Table 10 is then obtained by multiplying each column of Table 9 
by the corresponding entry in the third row of Table 7, namely, 
V1/d. For example, the fourth column of Table 10 is .50 times the 
fourth column of Table 9. Except for rounding errors, Table 10 is 
symmetric; and it gives all the partial correlation coefficients of order 
n—2. The diagonal entries are omitted. They should be —1.00 if com- 
puted as a check on the work. 


8. The Complete Set of Regressions for Factors 
Each row in Table 11 contains the n regression coefficients for 
predicting the indicated common factor from the n tests (when all 
the variables are in standard form). The regression coefficient in the 
ith row and jth column is obtained by multiplying each element in 
the ith row of (the top section of) Table 2 by the corresponding ele- 
ment in the jth row of Table 6 and adding the n products. For ex- 
ample, the regression coefficient for the fourth test for predicting the 
first common factor is 
(.7) (—.47) + (.6) (—.23) + (.5) (.17) + (.7) (4.02) 
+ (.6) (—1.29) + (.4) (—1.72) + (.8) (—.77) = .85. 


Notice that the last row of Table 11 is the same, except for sign, 
as the last row of the top section of Table 5 (line 11). This is in ac- 
cordance with what was pointed out in §6, that the entire worksheet 
is not needed if only a particular common factor is to be predicted. 
This also affords a numerical check on the work. 


The indexes of multiple correlation are computed by the general 
formula exhibited above in §7. This time the variable predicted is a 
common factor, and the correlation coefficients are the common factor 
loadings. The index for the jth common factor is obtained by multi- 
plying each element in the jth row of (the top section) of Table 2 by 
the corresponding element in the jth row of Table 11 and summing 
the products. This time, the diagonal entries in Table 6 are included 
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in the calculations, since all tests are used as predictors. 

Again, the coefficient of multiple correlation is the positive square 
root of the index of correlation. 

The computations for predicting the unique factors are rather 
simple. The regression coefficients in Table 12 are obtained by multi- 
plying each row of Table 6 by the corresponding entry in the seventh 
row of Table 2, namely w, the unique loading of the test containing 
the unique factor. For example, the fifth row in Table 12 is .53 times 
the fifth row of Table 6. 

The indexes of multiple correlation for the unique factors are 
again obtained by the general formula exhibited in §7 above. This 
time, the variable predicted is a unique factor, and the correlation 
coefficients are the correlations of the unique factor with the n tests. 
But these are all zero by the definition of a unique factor, except for 
the test containing the unique factor; so that n—1 of the terms in the 
sum vanish, leaving only the term from the test containing the unique 
factor. Thus, the index of multiple correlation of the jth unique fac- 
tor on the n tests is simply the unique loading of the jth test times 
the regression coefficient of the jth test. Therefore, the column of in- 
dexes in Table 12 is obtained simply by multiplying each diagonal 
element in the table by the corresponding element in the last row of 
Table 2 (namely, wu). For example, the index for the second unique 
factor is 

(1.58) (.53) =.84. 


Alternatively, and with more accuracy with respect to decimals, 
these same indexes could be obtained by multiplying the diagonal ele- 
ments of Table 6 by the corresponding elements in fifth row of Table 
2 (namely, u?, the uniqueness). Thus the index for the second unique 


factor is 
(2.98) (.28) =.83. 


Again, the multiple correlation coefficient is the positive square 
root of the correlation index. 
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TABLE 1 


The Intercorrelations of the Tests 
(The Matrix R) 






























































Test 
Test 1 2 3 4 5 6 ‘| 
i 1.00 -72 -75 AQ -42 .28 .56 
2 -72  ~=1.00 78 42 36 .24 48 
3 75 .78 1.00 35 .30 .20 -40 
4 49 42 29 =: 11.00 -78 76 .56 
5 42 .36 30 .78 1.00 2 48 
6 .28 .24 .20 -76 -72 ~=1.00 o2 
7 56 48 40 56 48 32 #=1.00 
TABLE 2 
Factor Loadings 
(The Matrix A’) 
Common Test 
Factor 1 2 3 4 5 
I “f 6 5 af 6 8 
II 5 6 8 
Ill 6 6 8 
Communality (h?) 74 ae 89 85 72 .80 64 
Uniqueness (wu?) 26 .28 Fy lk | 15 .28 .20 .36 
1/u? 8.85 3.57 9.09 6.67 3.57 5.00 2.78 
Unique Loading (x) 51 58 30 39 53 45 .60 
TABLE 3 
Augmented Common Factor Loadings 
(The Matrix A’U-") 
Common Test 
Factor 1 2 3 4 5 6 7 
I 2.70 2.14 454 467 214 2.00 2.22 
II 92 2414 I27 
III 4.00 2.14 4.00 
TABLE 4 
The Matrix Q 
(Q=I1+ AU~A) 
Common Common Factor 
Factor I YI III 
I 13.57 6.27 5.69 
II 9.06 
III 7.89 
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DIRECTIONS FOR FILLING OUT THE WORKSHEET 


The following are examples of how to read the symbois used in the directions 


below: 


22.5 refers to the entry in line 22, column 5 of the worksheet 
6.III refers to the entry in line 6, column III 

22.5 - 22.7 refers to the entries 22.5, 22.6, 22.7 

22 refers to all entries in line 22 


Line: 


ie 


2. 
3. 


12. 


13. 
14. 
15. 


16. 


17. 
18. 
19. 


4 
5 
6. 
7. 
8 
9 
10 


Insert in 1.I-1.III the first row of Table 4; insert in 1.1-1.7 the first row of 
Table 3 


Divide 1 by the negative of 1.1 


Insert in 3.II-3.III the second row of Table 4; insert in 3.1-3.7 the second 
row of Table 3 


Multiply 1.II-1.7 by 2.11 

38+4 

Divide 5 by the negative of 5.11 

oe = aa the third row of Table 4; insert in 7.1-7.7 the third row of 
able 


Multiply 1.1JI-1.7 by 2.III 

Multiply 5.1II-5.7 by 6.1II 

(+ Sit 9 

Divide 10 by the negative of 10.III 


1 
Insert in 12.1 the ne for test 1 from Table 2 
U 


Multiply 1.1-1.7 by 2.1 
Multiply 5.1-5.7 by 6.1 
Multiply 10.1-10.7 by 11.1 


1 
Insert in 16.2 the = for test 2 from Table 2 
u 


Multiply 1.2-1.7 by 2.2 
Multiply 5.2-5.7 by 6.2 
Multiply 10.2-10.7 by 11.2 


1 
Insert in 20.8 the —_ for test 3 from Table 2 
u2 


Multiply 1.38-1.7 by 2.3 
Multiply 5.3-5.7 by 6.3 
Multiply 10.3-10.7 by 11.3 


1 
Insert in 24.4 the = for test 4 from Table 2 
U 


Multiply 1.4-1.7 by 2.4 
Multiply 5.4-5.7 by 6.4 
Multiply 10.4-10.7 by 11.4 


1 
Insert in 28.5 the — for test 5 from Table 2 
uU 


Multiply 1.5-1.7 by 2.5 
Multiply 5.5-5.7 by 6.5 
Multiply 10.5-10.7 by 11.5 
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32. 
33. 
35. 
36. 
37. 


39. 
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1 
Insert in 32.6 the a for test 6 from Table 2 


U 


Multiply 1.6-1.7 by 2.6 
Multiply 5.6-5.7 by 6.6 


Multiply 10.6-10.7 by 11.6 


: 
Insert in 36.7 the — for test 7 from Table 2 
U 


Multiply 1.7 by 2.7 
Multiply 5.7 by 6.7 


Multiply 10.7 by 11.7 
































TABLE 5 
Worksheet for Computing the Inverse of the Correlation Matrix 
Line I II III 1 2 3 4 5 6 7 
1 13.57 627 5.69 2.70 214 4.54 4.67 2.14 2.00 2.22 
2 -100 -46 -42 -20 -16 84 -—84 -16 -.15 -.16 
38 006 000° 2592 2344 727 
4 -2.90 -2.68 -1.24 -.99 -2.10 -2.16 -99 -.92 -1.03 
5 6.17 -2.63 68 115 5.17 -2.16 -99 -.92 -1.03 
6 -1.00 48 j.-11 -.19 -.84 35 16 15 17 
7 7.89 4.00 2.14 4.00 
8 -2.38 -1.138 -90 -1.90 -196 -90 -—84 -.938 
9 -1.12 .29 49 220 -92 -42 -389 -.44 
10 439 —-—84 -.41 320 8=61.18 82 2.77 -1.37 
11 -1.00 19 09 --.07 -.26 -19 -.63 31 
12 3.85 
13 -538 -42 -.90 -.92 -42 -.40 -.44 
14 -08 -13 -.57 24 a 10 1 
15 -16 -.08 .06 22 16 538 —.26 
16 3.57 
17 -—34 -—72 -.74 -384 -—32 -35 
18 -22 -.97 40 19 17 19 
19 —.04 03 z 4 | .08 26 8 -.13 
20 9.09 
21 -1.52 -1.56 -.72 -67 -.74 
22 -4.34 1.81 83 78 86 
23 -02 -.08 -.06 -.19 .09 
24 6.67 
25 -161 -—74 -69 -.76 
26 -75 -85 -82 -.36 
27 -29 -—21 -71 35 
28 3.57 
29 -34 -382 —-.35 
30 -16 -15 -.16 
31 -.16 -.52 .26 
32 5.00 
33 -29 -.33 
34 -14 -.15 
35 -1.75 86 
36 2.78 
37 -.36 
38 -.17 
39 —.43 
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TABLE 6 
The Inverse of the Correlation Matrix 


(R2=U~ — U“AQ?AU~) 


181 





























Test 
Test 1 2 3 4 5 6 7 
1 8.08 -638 -141 -47 -.16 24 -.59 
2 -.63 2.98 -166 -.23 -.08 11 = -.29 
3 -1.41 -1.66 3.21 Pi yg 06 -.08 21 
4 -47 -.23 17 4402 -1.29 -1.72 -.177 
5 -16 -.08 06 -1.29 292 -.98 -.26 
6 24 11 -.08 -1.72 -98 2.82 .38 
7 -59 -.29 21 -.77 -.26 388 §=1.82 
TABLE 7 
Principal Diagonal Entries* 
(Diagonal Matrices D, D-?, D-') 
Test 
1 2 3 4 5 6 c 

d 3.08 2.98 3.21 4.02 2.92 2.82 1.82 

1 

a 82 34 31 25 34 05 55 

1 

— 57 58 56 50 58 .60 74 
Va 





* Each row of this table may be thought of as defining a diagonal matrix, the entries in each 
row of the table being the principal diagonal elements of the matrices. 


TABLE 8 


Multiple Regression Coefficients for Predicting the Tests 


(The Matrix -D-'!R-) 














Pre- Test (Predictor) Multiple 
dicted Correlation 
Test Coef- 
z 2 3 4 5 6 7 Index ficient 
1 20 .46 15 05 -—08 19 67 82 
2 21 56 .08 03 -.04 .10 67 82 
3 44 = =.52 -.05 -.02 .02 -.06 .69 83 
4 12 .06 -.04 ia. 45). 39 75 .86 
5 05 .08 -.02  .44 34 =6.09 .66 81 
6 -—08 -.04 .03 4.61 ~~ .85 -.13 64 .80 
7 22 86.16 -12 42 14 —21 44 67 
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TABLE 9 
(The Matrix -D-?R-1) 
Test 
Test 1 2 3 4 5 6 7 
i -1.75 36 .80 2a 09 -.14 84 
2 26 -1.78 .96 18 05 -.06 17 
3 -79 93 -1.79 -09 -.03 04 -12 
4 23 11 -.08 -2.01 64 .86 38 
5 .09 05 -.04 -75 -1.71 57 15 
6 -14 -.07 05 1.02 58 -1.68  -.23 
7 44 21 -.16 57 19 -.28 -1.35 
TABLE 10 
Partial Correlation Coefficients 
(The Matrix -D-?R-?D-?) 
Test 
Test 1 2 3 4 5 6 7 
1 21 45 13 05 -.08 25 
2 mo | 54 .06 03 -.04 12 
3 45 54 -.04 -.02 03 -.09 
4 13 06 -.04 387 51 .28 
5 05 03 -.02 OT 84 11 
6 -08  -.04 .03 51 34 -.17 
7 25 12 -.09 28 11 -.17 
TABLE 11 
Multiple Regression Coefficients for Predicting the Common Factors 
(The Matrix A’R-") 
Multiple 
Common Test Correlation 
Factor Coef- 
7 2 3 4 5 6 7 Index ficient 
I 27 12 -09 85 12 -—17  .48 81 .90 
II 08 .15 87 -—24 -08 12 -—30 .80 89 
III -19 -10 07 .26 19 .64 —381 -78 88 
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TABLE 12 


Multiple Regression Coefficients for Predicting the Unique Factors 
(The Matrix UR-) 














Multiple 
Unique Correlation 
Factor Coef- 
1 2 3 4 5 6 ff Index ficient 
1 157 -382 -.72 -.24 -.08 .12 -.380 .80 89 
2 -—33 158 -.88 -12 -.04 .06 -.15 84 92 
3 -—47 -.55 1.06 .06 .02 -03 .07 35 59 
4 -—18 -.09 .07 156 -.50 -.67 -.30 41 64 
5 -08 -04 03 -68 1.55 -.52 -.14 82 91 
6 ll 4 «4.05 -.04 —77 -.44 1.26 4.17 57 -76 
és -—385 -—17 18 -46 -16 .28 1.09 65 81 








REFERENCES 


Dwyer, Paul. The evaluation of multiple and partial correlation coefficients 
from the factorial matrix. Psychometrika, 1940, 5, 211-232. 

Guttman, Louis. Multiple rectilinear prediction and the resolution into com- 
ponents. Psychometrika, 1940, 5, 75-99. 

Guttman, Louis. An outline of the statistical theory of prediction. Supple- 
mentary study B-1 in Paul Horst et al., The prediction of personal adjust- 
ment, 1941, Social Science Research Council. Pp. 250-312. 

Holzinger, Karl J. Student manual of factor analysis. Department of Edu- 
cation, University of Chicago, 1937. 

Ledermann, Walter. On a shortened method of estimation of mental factors 
by regression. Psychometrika, 1939, 4. 109-116. 








SEPTEMBER, 1943 
PSYCHOMETRIKA—VOL. 8, NO. 3 


A PREFERENTIAL MATCHING PROBLEM 


LT. J. A. GREENWOOD, U. S. N. R. 
BUREAU OF AERONAUTICS, NAVY DEPARTMENT, WASHINGTON, D. C. 


A matching method proposed by Dr. C. E. Stuart is presented in 
some detail and the essentials for a test of significance are derived. 
This method differs from the older matching methods in that partial 
credit is allowed for a near miss. A slight variation of the method 
permits the matching of one item with M sets of n traits. 


The matching method provides a means of applying statistical 
treatment to observations which cannot easily be classified according 
to fixed criteria. A simple form of the matching problem is the fol- 
lowing: Suppose five sets of identical twins provide handwriting 
specimens. Five specimens, consisting of one specimen from each 
pair, are placed before a judge. He is asked to match the other five 
specimens to the first set according to degree of similarity. His re- 
sulting five similar pairs are then checked for agreement with the 
original twin pairing. If a consistently greater-than-chance agree- 
ment is noted, then it is possible to conclude safely that the hand- 
writing of identical twins is similar even though there exist no fixed 
objective criteria of similarity. 

In recent years there has been considerable literature on the sub- 
ject of matching techniques similar to the above. As far as I have 
ascertained, they have dealt only with the numbers of perfect corre- 
spondences. Stuart (1) has recently proposed a technique in which 
each of the comparing items is “preferentially matched” or rated 
against each of the compared ones, depending on their closeness of 
“similarity.” 

This paper presents the mathematics of the latter situation and 
in addition presents a new aspect of the method. It is divided into 
cases (i), (ii), and (iii), of which the first two represent a formal 
description and derivation of the mathematics of Stuart’s method. A 
brief description of the matching method under discussion follows. 

Let two sets of items to be matched be A; and B;,i=—1,2,-:--, 
n. A, is compared to each of the B; and the one which it most nearly 
“resembles” is given the number 7 ,* the one next to it in “resem- 


* Stuart gave it the value of 1. The mean and variance of the score are the 
same for the two ways of numbering. 
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blance” is given the number n—1, and so on to 1. This procedure is 
done with each A;. Suppose A, really paired with B,. Then with 
perfect recognition of the true association, B, would have been allo- 
cated n. However, any number from 1 to may actually have been 
given it. The numbers thus allocated to the true correspondences of 
the A; are summed as the test score. 

It is clear that the set of assignments can be displayed in an 
n-square matrix where the number in the i-th row and j-th column is 
that assigned when A; is compared with B;. The test score is then 
the sum of the numbers on the principal diagonal,* providing A; and 
B; are true correspondences for i=—1,2,-:-,”. Thus a matrix with 
n= 4 and test score of 12 is illustrated by the accompanying diagram. 





B, Be Bs, Ba 
on a a 
A, | 3 1 2 4 
a = 2 °2 
A4;2 4 1 8 


Two cases are distinguished in practice. Case (i): The alloca- 
tions in any row are considered independent of all the other rows ex- 
cept inasmuch as actual similarities influence the decisions. Case 
(ii): Each column (and of course each row) must contain an 7. This 
necessitates remembering which B; has already been allocated a value 
n, and not thereafter assigning it an x. Something between case (i) 
and case (ii) appears to take place in actual experiments. That is, 
the judges appear to be influenced by their previous allocations of 
“firsts” - - those receiving n - - but the difficult memory feat involved 
seems to preclude its effective extension to “seconds,” etc. 

In both cases (i) and (ii), the null hypothesis assumes that a 
priori each matching of an A; witha B; (1,7 =1,2,---,m) has the 
same probability of an n, n — 1,---, or 1 assignment. This is ob- 
viously not to say that the assignments are independent. 


Case (1) 


On a chance basis the probability of a score of r is the coefficient 
of x’ in 





nN 


2+ oy? +... n\n 
s@ma(" g* + aay. 


* That is, from the upper left-hand corner to the lower right-hand corner. 
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Therefore, the j-th factorial moment of r is K; = ¢"!(1), the j-th 
derivative of ¢(x) evaluated at x = 1. In order to obtain the mo- 
ments about the mean, wu; , i= 2,3, 4, it is thus necessary to obtain 
the first four derivatives of ¢(x).* This is facilitated by carrying out 
the differentiation of ¢(x) in terms of A(z) =a + a? +--- + x" and 
its derivatives. The straightforward differentiation is omitted, but 
the essential values used are 


(n op 1) (i4+1) 
a+1 
Substituting these derivatives evaluated at x = 1 in the formu- 


las connecting factorial moments K; and ordinary central moments 
i, we obtain the following: 


A‘“‘l(1) = 


mean = K,=—n(n+1)/2, 
variance = uw, = K, + K, — K,?= (n+ 1) /12, 
us = K, + Me (3 — 3K,) — (K,° — 3K,? + 2K,) =0, 


f= Ky a bs (6 er 4K,) be [2 (6K,? nee 4 18K, + 11) 
+ (6K,° ae K,4 a 11K,? se 6K,) 








(n +1) 
949 (5n? — 2n? — 5n — 2), 
Us 0 4 3 (5n3 — 2n? — 5n — 2) 
ae — Some ; Os = 
, [p32 tte? 5n(n? — 1) 
lim a, = 3. 
Case (ii) 
Let 


Let M,” 4 - Jie — q be the number of terms in a determinant of or- 


der m, each term having q elements, only, of the principal diagonal. 
The probability of 7 ”’s on the principal diagonal of the matrix of 


* We note that for case (i) the desired moments could be obtained ulti- 
mately from the moments of the score of a single cell of the matrix. 


+ Define a‘) = a(a—1) -:- (a — 6 + 1), b a positive integer. 








188 PSYCHOMETRIKA 


numbers is then M;"/n!. The prevability generating function of the 
total score on the principal diagonal is ¥ (x) where 





nl («) =¥ M, a" 


1=0 


eth acl sly aa 
eh = ee la 
Again the mean score K, equals V' (1) and K, = ¥"!(1). 

In order to maintain the upper limit n on the summation sign 
throughout the successive differentiations, it is sufficient to bound x 
away from zero in a neighborhood about 1. The following values are 
also needed. 


SM," = n! since (1) = 1; 


1-0 


n 
1M,"*=n M"™ soy>iM"*=n! ; 
i=0 


SM" =2(n!). 


Carrying through the differentiation in terms of a(x) = (x + 2? 
+++. + 4""1)/(n — 1), from which a(1) = 1, «1 (1) = 7/2, a%1(1) = 
n(n — 2)/3, one readily obtains K, = n(n + 1) /2 as in case (i). 

After substituting the derivatives of a(x) in Y')(x), all eval- 


uated at x = 1, there results K, = V™!(1) =< (Sn* + Tn* — 3n — 4), 





variance = uw, = K, + K, — K? = = (n? + 2) =(1 + = zs t, times 
Me Of case (i). 

To obtain the third and fourth moments of case (ii) by this 
method of attack would be considerable of an exercise. If it is de- 
sired to evaluate the sum of results of a repetition of such an experi- 
ment as encompassed by either case (i) or case (ii), one need only 
apply the usual formulas for the moments of a mean. 

As an illustration of this technique, one attempts to identify au- 
thors of handwriting specimens with character sketches of each. Let 

n==number of specimens (or sketches), 

A;=handwriting specimen of i-th author, 

B;= character sketch of j-th author. 

In the experiment to test whether or not to a given judge the hand- 
writing specimens exhibit significantly identifying properties in com- 
mon with the true associated character sketches, all identifying marks 
should be removed from all the A’s (or the B’s) and a code substituted 
before handing over to the judge. The procedure described previously 
should then be carried out by the judge and the score totaled by the 
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experimenter, after decoding so that the true correspondences of the 
A’s can be identified. 

Now it might well happen that A,, say, suggested both B, and 
B; and that B; is the true associate of A,. The usual “correct maich- 
ing” procedure depends for any value of the matching. score upon 
deciding correctly which of the two it should be, and further, if it is 
missed, it affects adversely the possibility.of correctly associating the 
remaining ones. (This is the method where in effect the B’s are lined 
up and the A’s opposite them in one-to-one correspondence and cor- 
rect pairings counted, for the score.) On the other hand, in the pres- 
ently suggested method, at worst B; is allocated n — 1 and B; the 
value n. Thus it contributes n — 1 to the total score and has no 
effect in case (i) and little effect in case (ii) on the remaining match- 
ings. This would appear to indicate the essential advantage of the 
proposed method. 

In order to test the null hypothesis, the difference between the 
observed score and the theoretical value n(n + 1) /2 is divided by the 
standard deviation of case (i) or case (ii) (whichever the experi- 
menter decides is more applicable) and the norma] tables entered for 
an approximate probability. In the illustration at the beginning of 
the article n = 4, score = 12, theoretical mean = 10, and standard 


deviation [assuming case (ii)] is \/6. While for only one sample n 
is too small to admit of accurate evaluation on the assumption of nor- 


mality,* the formal procedure gives a critical ratio of (11.5 — 10)/V6 
= 0.61 with a probability of .3, roughly, of obtaining a score as large 
as 12.7. 
Case (tit) 
A different situation is involved in the following illustration. 
Choose M subjects (of comparable age and physical condition) and 
list n selected trait descriptions of each, as: measure of initiative, 


sample of handwriting, reaction time on a certain test, etc. Suppose 
the question is whether or not a photograph of a selected person of 


* Even in the more favorable case (i), it appears that for a reasonably good 
evaluation of the single sample by normal tables the number of pairs to be 
matched should be in the neighborhood of 20. However, the more likely situation 
to be evaluated is that of an experiment consisting of a series of such matchings 
of equal numbers of pairs. (In this connection note a caution by the author in 
J. Psychol., 1940, 53, 614-615, to the effect that the same material should not be 
matched more than once.) The distribution of the sum of scores obtained is rea- 
sonably close to normal when the number of pairs and numbers of matchings are 
at least as large as 4 and 8, respectively. However, if either number were made 
much larger, then the other could be made smaller. 


+ To allow for discontinuity of the data, the deviation is reduced half a unit. 
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the group of M can be reliably (in the sense of statistically signifi- 
cantly) associated with the correct set of trait descriptions. 

Designate the j-th trait of the i-th subject as B;; and the prop- 
erty of the chosen subject (photograph, e.g.) as A. The procedure 
is as follows: All identifications of traits to subjects are removed and 
code substituted. The sets of traits are randomized and a judge is 
asked to preferentially match A with each of the sets B,;, B2;,---, 
Bij, 7 =1,2,---,n”. The score s is the sum of numbers assigned 
to each of the true associates of A in the preferential matching pro- 
cess. 

There are two possibilities to consider. The chosen traits have. 
(a) assignments uncorrelated by pairs, or (b) assignments correlated 
by pairs. Let px: be the theoretical correlation between assignment 
score of traits of k andl. 

Under the assumption of equi-probability that each of the traits 
B;; corresponding to A be assigned any value from 1 to M, we may 
utilize the results of case (i). This gives the mean and variance of a 
single cell of the matrix of assignments to be (M + 1)/2 and 
(M? — 1)/12, respectively. Then applying formulas for the mean 
and variance of a linear expression of variates, 


mean score = n(M + 1)/2, 





1,2,-°-,” M2 ides 1 * 
Mo:, = Variance of score =(" +235 Pi) 1D ) ; 


i<j 
If the trait scores may be considered as uncorrelated, then 


pij — 9 and 
He:, = n(M? — 1)/12. 


For convenience, a form matrix for scoring is shown in the illus- 
tration below in which B; indicates the j-th trait. Under each B; is 
the column of values preferentially assigned to the j-th trait of each 
of the subjects. The matrix can of course be filled in only after the 
traits have been decoded. 

Illustration: Let M = 6, n = 3, and suppose that the selected 
subject was in actuality the second one. Let the completed matrix 
have the following form: 


* It is recognized that estimates, only, of p;; may be known, and error there- 
by introduced into the use of 4#,.,. 
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B, Ba. B; 
3 1 5 
5 3 6 
1 6 1 
4 4 1 
6 2 4 
2 5 3 


Assuming pi; = 0, then the mean = 10.5, mm:5 = 8.75, of = 2.96, 
s = 14. Critical ratio = (13.5 — 10.5) /2.96 = 1.01. Referring to 
the normal tables, the probability that a score as large as 14 would 
have been obtained equals .16.* 


* Under the assumption that p;; — 0, the same general restrictions as to sizes 
of n and M for using the normal tables hold as for case (i). I am unable to give 
any exact statements and proofs of minimum values for m and M for given desir- 
able approximations to true probabilities when using normal tables. However, 
from examining the values of a, and a, for selected values of », M, I would se- 
lect n = 3 and M = 6 as minimum values for these constants. Of course in- 
creasing 2 would permit the decreasing of M. 
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TABLES OF THE STANDARD ERROR OF TETRACHORIC 
CORRELATION COEFFICIENT 


SAMUEL P. HAYES, JR. 


Tables are given for o,VN for the tetrachoric correlation co- 
efficient for the following values of the correlation in the population: 
00, + .10, + .20,---, + .80, + .90, + .95. 


The tetrachoric coefficient of correlation is an easily understood 
and widely applicable measure of relationship. In particular, it is 
valuable for the measurement of relationship between variables which 
are not themselves quantitatively measurable. The labor of comput- 
ing this coefficient has been overcome by the development of certain 
short-cut methods of approximation which make possible its rapid 
computation with a degree of precision which is adequate for all or- 
dinary purposes (1, 8). 

Wide use of the tetrachoric coefficient has been hindered, how- 
ever, by the difficulty of computing its standard error. The formula 
for this standard error was originally developed by Pearson (6).* 
It is as follows: 


es 1 {see (a+c)(b+d) 
C=. zi 
‘Yo VN 4 N? . N?2 
(a+ b)(c+d) (ad — be) 
WN? +2, ¥, “ae 
(ab — cd) (ac — bd)” 
— ¥,—— - 











+ wr, 





x x 
where ¥, = area of the normal curve between — = 0 and — = #,, 
Cc Cc 


Y, = area of the normal curve between 2 = 0 and Y= Bz, 
Co Cc 


*In Pearson’s original article, x, was erroneously printed under the radical 
instead of outside it. The full formula is given correctly in a later article by 
Pearson (5). In a recent text by Peters and Van Voorhis (9), the full formula 
is correctly given, but the meanings of @, and 8, are transposed from their mean- 
ings in Pearson’s original formula. 
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k—rk , k—th 
en, ig eee, 
i et ae va 
(Note that, in using this formula, #, or £., with the cor- 
responding ¥Y, may be negative.) 


1 hask22rhk 
=——mietyi- mp (es > , 


0 





h=— for normal] curve divided into (a + c) and (b+ d), 
Cc 


k= for normal curve divided into (a + b) and (c+ d). 


(Note that h and k must always be positive, i.e., (a + ¢) must be ar- 
ranged to be greater than (b + d) and (a + b) to be greater than 
(c + d). Also, if r is negative with respect to cells a and d, its sign 
must be used in the above formula.) 

As an alternative to the full formula for the standard error of 
tetrachoric 7, Pearson (5) developed an approximation formula which 
is much easier to compute. This formula is as follows: 








7% 


_ V(a+t+ b) (e+ d)(a+c)(b+d) sin 7\ 2 3 
2 Ee fof eT 
ze’ VN 90 


In order to simplify computation further, he and other statisti- 
cians have computed the values of the function within the bracket for 
various values of 7; , and have presented them in tables (3, 4, 5, 7).* 

Pearson (7) states that the value given by this formula for the 
standard error “is only approximate and may diverge considerably 
from the true value for extreme dichotomies.” Unfortunately, how- 
ever, this approximation formula has been adopted for general use 
without observing the degree of caution displayed by Pearson himself. 
For example, a recent article (3) states that “the standard error of 
a tetrachoric 7 is given” (italics mine) by this approximation for- 
mula. The statement could have been phrased more properly as “the 
standard error of a tetrachoric 7 is approximated by this formula in 
many cases, especially where the value of 7; does not exceed .80 and 
where the dichotomy of one variable is fairly similar to the dichotomy 
of the other.” 


*In one article (3), the values tabled by Pearson (7) have been recomputed 
without reference to their earlier publication. When compared with Pearson’s 
= the later tables show several discrepancies in the last figure of the tabled 
values. 
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The fact is that the standard error computed by the approxima- 
tion formula may diverge very greatly from the standard error com- 
puted from the full formula. If 7; is negative, the true value of o,, 
is usually considerably larger than the approximated value, except 
where one of the variables is divided into fairly equal parts. And if 
there is a marked difference between the dichotomy of one variable 
and the dichotomy of the other, the true value of o,, for high values 
of 7, may be much larger than the approximated value even where 
neither dichotomy is extreme (see Table 1, Part A). The difference 
between these two values increases as the value of 7; increases. In 
fact, paradoxically, certain high values of 7; may have larger stand- 
ard errors than lower values, even where the dichotomies of both vari- 
ables in one case are the same as those in the other. Finally, the true 
value and the approximated value are quite similar for positive 7; 
in the case of even extreme dichotomies if the dichotomies of both 
variables are equally extreme (Table 1, Part B). 


TABLE 1 
Examples of Values of o,, as Determined by the Full Formula and by the 


Approximation Formula (It is assumed that N = 100 in every case.) 














Part A Part B 
Variable A split 50-50 Variable A split 95-5 
Variable B split 84-16 Variable B split 95-5 
Approximated True Value, Approximated True Value 
a Value, Positive Positive or T; Value, Positive Positive Negative 
or Negative r+ Negative rt or Negative rT: Tt Te? 
.00 19 19 .00 42 42 42 
10 19 19 10 42 39 45 
.20 18 18 .20 Al 36 50 
30 18 18 30 09 39 56 
40 17 17 40 OT 31 64 
50 15 16 50 34 27 83 
.60 14 15 .60 ol 24 1.26 
-70 12 13 -70 26 20 2.62 
.80 .09 11 80 .20 15 13.6 
-90 .06 10 90 13 09 _— 
95 04 16 95 .08 .06 _ 








In order to use the tables presented in this paper, the data of the 
tetrachoric table being examined should be reduced to percentages and 
arranged so that the smaller column is on the left and the smaller row 
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is at the top. Figure 1 is arranged in this way. Note thata + b < 
c+danda+c<b+d. 














10% | 20% | 30% a | b | a+b 

10% | 60% | 10% c | d Mis d 

20% | 80% | 100% ate | b+d | WN 
FIGURE 1 


Proper Arrangement of Data Preparatory to Computation of 
Standard Error of Tetrachoric Coefficient 


The following tables give values of o, ’ VN for certain positive 
and negative values of 7; for certain dichotomies of each variable, up 
to the point where the dichotomic lines fall 2.6 o/x from the means 
(i.e., where the dividing line leaves only 1/2 of 1% in the tail of the 
distribution of either or both variables). Rectilinear interpolation 
within and between these tables will give approximate values which 
are very close to the true values and which are quite adequate for all 
ordinary purposes. Graphic curvilinear interpolation will give val- 
ues even closer to the true values. Of course, in order to translate the 
value of o,, VN into o,, , the tabled values must be divided by the 
square root of N for the data used in the particular case. 

Separate parts of each table give values of o,, VN for positive 
and negative values of r,. The sign of 7; is determined by the relative 
volume of that cell of the tetrachoric table that falls in the smaller 
column and the smaller row of the tetrachoric table. In other words, 
it is determined by the relative volume of cell a in a table arranged 
as in Figure 1. The theoretically expected volume of cell a is, of course, 
(a+b)(a+ ec) 

N ‘ 
theoretically expected volume, 7; is positive. If the actual volume of 
cell a is less than the theoretically expected volume, 7; is negative. The 
value of o,, for positive r, differs from that for negative 7, except 
where one or both of the variables is divided into equal parts, in which 
case the two values are identical. 

These tables were computed by using the tables given by Pearson 
(8) of the volume of one cell of a tetrachoric table. In fairly extreme 
cases, the values given here may be in error by one or two points in 
the third significant figure. Furthermore, because the Pearson tables 
contained no entries for very extreme cases, standard errors were not 
computed for these cases and the tables given here are therefore in- 
complete. The cases omitted are so extreme, however, that the utility 





If the actual volume of cell a is greater than the 
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of the tables will not be seriously impaired by their omission. If occa- 
sion arises to compute them, the tables of tetrachoric functions given 
in Pearson (7, 8), and certain recently computed tables of other func- 
tions (10, 11, 12), will be found very useful. 


TABLE 2 
o,, VN for r, = .00 
t 




































































% of combined groups above criterion: 
% of combined 
groups falling 50% 30.9% 15.9% 5.48% 2.28% 0.466% 
insmaller = fy/o_ x/o=0.0 0.5 1.0 1.6 2.0 2.6 
group: 
‘= +.00 
50% 0.0 1.57 1.64 1.89 2.57 3.46 6.28 
30.9% 0.5 1.64 1.72 1.98 2.69 3.62 6.58 
15.9% 1.0 1.89 1.98 2.28 3.10 4.17 7.57 
5.48% 1.6 2.57 2.69 3.10 421. | 5.67 10.29 
2.28% . 2.0 3.46 3.62 4.17 5.67 | 7.68 -13.85 
0.466% 2.6 6.28 6.58 7.57 10.29 13.85 25.15 
TABLE 3 
o, VN for r, = +.10 and r, = —.10 
% of combined groups above criterion: 
+o 50% 30.9% 15.9% 5.48% 2.28% 0.466% 
groups falling 0 «7/0 s90.d'7/0 0. 0 . ‘0 . ‘0 
insmaller = |y/g x /o=0.0 0.5 1.0 1.6 2.0 2.6 
group: - 
rT, == +.10 
50% 0.0 1.56 1.68 1.88 2.56 8.45 6.30 
30.9% 0.5 1.63 1.70 1.95 2.68 3.52 6.35 
15.9% 1.0 1.88 1.95 2.22 2.96 3.94 7.02 
5.48% 1.6 2.56 2.63 2.96 3.91 5.15 9.04 
2.28% 2.0 3.45 3.52 3.94 5.15 6.74. 11.70 
0.466% 2.6 6.30 6.35 7.02 9.04 11.70 19.82 
r, = —-10 t 
50% 0.0 1.56 1.63 1.88 2.56 8.45 6.30 
30.9% 0.5 1.63 1.72 1.99 2.74 3.72 6.86 
15.9% 1.0 1.88 1.99 2.32 8.21 4,42 8.31 
5.48% | 1.6 2.56 2.74 3.21 4.55 6.30 12.00 
2.28% | 20 345 3.72 442 630 880 16,97 
0.466% | 2.6 6.30 6.86 8.31 1200 16.97 88.46 




















198 


PSYCHOMETRIKA 


TABLE 4 


0, VN for r, = +.20 and r, = —.20 








% of combined groups above criterion: 







































































Wet eunhined 50% 30.9% 15.9% 548% 2.28% 0ACE% 
groups falling 
in smaller y/o x/o—0.0 0.5 1.0 1.6 2.0 2.6 
iced 7, = +.20 
50% 0.0 1.53 1.60 1.85 2.53 3.48 6.35 
30.9% 0.5 1.60 1.66 1.89 2.55 3.41 6.15 
15.9% 1.0 1.85 1.89 2.13 2.82 3.72 6.55 
5.48% 1.6 2.58 2.55 2.82 3.63 4.71 8.05 
2.28% 2.0 3.48 8.41 3.72 4.71 6.02 10.1 
0.466% 2.6 6.35 6.15 6.55 8.05 10.1 16.3 
T,——.20 
50% 0.0 1.53 1.60 1.85 2.53 3.43 6.35 
30.9% 0.5 1.60 1.69 1.98 2.77 3.82 7.25 
15.9% 1.0 1.85 1.98 2.35 3.37 4.73 9.24 
5.48% 1.6 2.58 2.77 3.37 4.98 717 146 
2.28% 2.0 3.48 3.82 4.73 7.17 10.5 21.9 
0.466% 2.6 6.35 7.25 9.24 14.6 21.9 48.1 
TABLE 5 
o,, VN for r, = +.30 and r, = —.30 
; % of combined groups above criterion: 
rns 50% 30.9% 15.9% 5.48% 2.28% 0.466% 
in smaller y/o x/o=0.0 0.5 1.0 1.6 2.0 2.6 
group: + 
50% 0.0 1.47 1.54 1.79 2.48 3.40 6.46 
30.9% 0.5 1.54 1.59 1.81 2.44 3.27 5.98 
15.9% 1.0 1.79 1.81 2.02 2.65 3.49 6.13 
5.48% 1.6 2.48 2.44 2.65 3.85 4.28 7.22 
2.28% 2.0 3.40 3.27 3.49 4.28 5.38 8.71 
0.466% 2.6 6.46 5.98 6.13 7.22 8.71 13.6 
rT, = —.30 
50% 0.0 1.47 1.54 1.79 2.48 3.40 6.46 
30.9% 0.5 1.54 1.65 1.95 2.79 3.94 7.82 
15.9% 1.0 1.79 1.95 2.37 3.58 5.15 10.7 
5.48% 1.6 2.48 2.79 3.58 5.58 8.46 18.8 
2.28% 2.0 3.40 3.94 5.15 8.46 18.1 30.8 
0.466% 2.6 6.46 782 10.7 18.8 30.8 76.4 

















SAMUEL P. HAYES, JR. 199 


TABLE 6 
o,, WN for r, = +.40 and r, = —. 













































































. % of combined groups above criterion: 
saneustiies 50% 30.9% 15.9% 5.48% 2.28% 0.466% 
insmaller = |y/o x/o—0.0 0.5 1.0 1.6 2.0 2.6 

group: 
r,—+ 40 
50% 0.0 1.39 1.46 1.70 2.40 3.37 6.71 
80.9% 0.5 1.46 1.50 1.70 2.31 3.12 5.84 
15.9% 1.0 1.70 1.70 1.89 2.46 3.24 5.73 
5.48% 1.6 2.40 2.31 2.46 3.05 3.87 ° 6.50 
2.28% 2.0 3.37 3.12 3.24 3.87 4.78 7.64 
0.466% 2.6 6.71 5.84 5.73 6.50 7.64 11.4 
rT, —= —.40 
50% 0.0 1.39 1.46 1.70 2.40 3.37 6.71 
30.9% 0.5 1.46 1.57 1.90 2.82 4.12 8.80 
15.9% 1.0 1.70 1.90 2.39 3.78 5.80 13.3 
5.48% 1.6 2.40 2.82 3.78 6.45 10.6 26.9 
2.28% 2.0 3.387 4,12 5.80 10.6 18.2 50.5 
0.466% 2.6 6.71 8.80 13.3 26.9 50.5 151. 
TABLE 7 
o, VN for 7, = +.50 and r, = —.50 
: % of combined groups above criterion: 
sind 50% 30.9% 15.9% 5.48% 2.28% 0.466% 
insmaller = |y/o_ «/o=0.0 0.5 1.0 1.6 2.0 2.6 
group: 
Tr, — +.50 
50% 0.0 1.28 1.385 1.60 2.32 3.37 1.24 
30.9% 0.5 1.35 1.38 1.57 2.15 2.96 5.79 
15.9% 1.0 1.60 1.57 1.72 2.24 2.95 5.34 
5.48% 1.6 2.32 2.15 2.24 2.73 3.44 5.73 
2.28% 2.0 3.37 2.96 2.95 3.44 4.19 6.60 
0.466% 2.6 7.24 5.79 5.34 5.73 6.60 9.56 
rT, = —.50 
50% 0.0 1.28 1.35 1.60 2.32 3.37 7.24 
80.9% 0.5 1.35 1.48 1.83 2.89 4,47 10.7 
15.9% 1.0 1.60 1.83 2.42 4,21 7.00 18.6 
5.48% 1.6 2.32 2.89 4.21 8.32 15.2 45.6 
2.28% 2.0 3.37 4,47 7.00 15.2 29.0 95.0 
0.466% 2.6 7.24 10.7 18.6 45.6 95.0 —_ 
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TABLE 8 
o,, VN for r, = +.60 and r, = —.60 
: % of combined groups above criterion: 
ee ee 50% 30.9% 15.9%  5AB% 2.28% 0.466% 
insmaller = jy/o x/o—0.0 0.5 1.0 1.6 2.0 2.6 
— r, = +.60 
50% 0.0 1.15 1.21 1.46 2.24 3.46 8.50 
30.9% 0.5 1.21 1.23 1.40 1.96 2.79 5.94 
15.9% 1.0 1.46 1.40 1.53 1.98 2.64 4.99 
5.48% 1.6 2.24 1.96 1.98 2.38 2.98 5.00 
2.28% 2.0 3.46 2.79 2.64 2.98 3.59 5.61 
0.466% 2.6 8.50 5.94 4.99 5.00 5.61 7.88 
7, = —.60 
50% 0.0 1.15 1.21 1.46 2.24 3.46 8.50 
30.9% 0.5 1.21 1.36 1.76 3.04 5.21 165.* 
15.9% 1.0 1,46 1.76 2.52 5.09 964 32.2 
5.48% 1.6 2,24 3.04 5.09 12.6 26.8 110. 
2.28% 2.0 3.46 5.21 9.64 268 61.2 214. 
0.466% 2.6 8.50 15.* 32.2 110. 214. _— 
* By curvilinear interpolation. 
TABLE 9 
0, VN for r, = +.70 and r, = —.70 
% of combined groups above criterion: 
% of combined 
groupe falling 50% 30.9% 15.9% 5.48% 2.28% 0.466% 
insmaller = [y/o x/o=0.0 0.5 1.0 1.6 2.0 2.6 
group: 
T,=—+ .70 
50% 0.0 97 1.04 1.30 2.21 385 121 
30.9% 0.5 1.04 1.05 1.20 1.75 2.65 6.68 
15.9% 1.0 1.30 1.20 1.29 1.68 2.30 4.77 
5.48% 1.6 2.21 1.75 1.68 1.98 2.47 4.27 
2.28% 2.0 3.85 2.65 2.30 2.47 2.94 4.60 
0.466% 2.6 12.1 6.68 4.77 4.27 4.60 6.27 
T,=—.10 
50% 0.0 97 1.04 1.30 2.21 SS ae 
30.9% 0.5 1.04 1.21 1.70 3.57 if) 
15.9% 1.0 1.30 1.70 2.85 752 17.8 — 
5.48% 1.6 2.21 3.57 752 26.2 71.5 806. 
2.28% 2.0 3.85 7128 1723 71.5 _— sons 
0.466% 2.6 12.1 — ae 806. oom ow 
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TABLE 10 
o,, VN for 7, = +.80 and r; = —.80 
% of combined groups above criterion: 
% of combined 
groups falling 50% 80.9% 15.9% 5.48% 2.28% 0.466% 
insmaller = [y/o x/o = 0.0 0.5 1.0 1.6 2.0 2.6 
group: 
r, = +.80 
50% 0.0 -76 .83 1.12 2.44 5.57 30.4 
30.9% 0.5 83 81 95 1.58 2.73 10.0 
15.9% 1.0 1.12 95 .99 1.33 1.94 5.07 
5.48% 1.6 2.44 1.538 1.33 1.51 1.90 3.63 
2.28% 2.0 5.57 2.73 1.94 1.90 2.21 3.538 
0.466% 2.6 80.4 10.0 5.07 8.63 3.53 4.75 
rT, = —.80 
50% 0.0 -76 83 1.12 2.44 5.57 30.4 
30.9% 0.5 .83 1.04 1.79 5.66 19.* — 
15.9% 1.0 1.12 1.79 4.20 19.4 75.4 — 
5.48% 1.6 2.44 5.66 19.4 136. — a 
2.28% 2.0 5.57 19.* 75.4 a - — 
0.466% 2.6 80.4 — — — — — 
* By curvilinear interpolation. 
TABLE 11 
o,, VN for 7, = +.90 and r, = —.90 
% of combined groups above criterion: 
% of combined 
groups falling 50% 80.9% 15.9% 5.48% 2.28% 0.466% 
insmaller [y/o x/o=0.0 0.5 1.0 1.6 2.0 2.6 
group: 
r, = +.90 
50% 0.0 48 55 1.02 5.46 80.5 — 
80.9% 0.5 55 51 63 1.55 4.89 — 
15.9% 1.0 1.02 63 .62 91 1.74 7.46 
5.48% 1.6 5.46 1.55 91 .93 1.21 3.11 
2.28% 2.0 30.5 4.89 1.74 V2 1.35 2.35 
0.466% 2.6 — — 7.46 3.11 2.85 2.75 
fr, = —.90 
50% 0.0 48 55 1.02 5.46 30.5 —_— 
80.9% 0.5 55 .96 3.20 14.4 _— ~ 
15.9% 1.0 1.02 3.20 6.97 — —_ _ 
5.48% 1.6 5.46 14.4 — — — — 
2.28% 2.0 80.5 _— — — —_ — 
0.466% 2.6 — —_— — — — —_— 
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TABLE 12 
o,, VN for r, = +.95 and r, = —.95 






































f % of combined groups above criterion: 
Hope 0% 30.9% 15.9% ——5.AB% 2.28% 0.466% 
insmaller = |y/o x/o=0.0 0.5 1.0 1.6 2.0 2.6 
group: 
Tr, = +.95 
50% 0.0 .»80 40 a! is dase 
30.9% 0.5 40 32 A5 “—. + st 
15.9% 1.0 1.62 A5 38 71 sa = 
5.48% 1.6 ~ 2.94 71 BT 80 4.94 
2.28% 2.0 7 inte 2.63 80 82 1.78 
0.466% 2.6 ie ae sain 4.94 1.78 1.66 
eid r, = —.95 
50% 0.0 30 40 = on 
30.9% 0.5 40 1.52 30.6 ee im sine 
15.9% 1.0 1.62 30.6 mn site Pars me 
5.48% 1.6 ies ste oa nn — Jit 
2.28% ee is iad dni soe sh 


0.466% 


| 


2.6 
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